Dec 05 13:34:34 user nova-compute[75233]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75233) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75233) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75233) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 13:34:34 user nova-compute[75233]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:34:34 user nova-compute[75233]: INFO nova.virt.driver [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 05 13:34:34 user nova-compute[75233]: INFO nova.compute.provider_config [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Acquiring lock "singleton_lock" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Acquired lock "singleton_lock" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Releasing lock "singleton_lock" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Full set of CONF: {{(pid=75233) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ******************************************************************************** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Configuration options gathered from: {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ================================================================================ {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] allow_resize_to_same_host      = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] arq_binding_timeout            = 300 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] backdoor_port                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] backdoor_socket                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] block_device_allocate_retries  = 300 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] block_device_allocate_retries_interval = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cert                           = self.pem {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute_monitors               = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] config_dir                     = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] config_drive_format            = iso9660 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] config_source                  = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] console_host                   = user {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] control_exchange               = nova {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cpu_allocation_ratio           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] daemon                         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] debug                          = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] default_access_ip_network_name = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] default_availability_zone      = nova {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] default_ephemeral_format       = ext4 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] default_green_pool_size        = 1000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] default_schedule_zone          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] disk_allocation_ratio          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] enable_new_services            = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] enabled_apis                   = ['osapi_compute'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] enabled_ssl_apis               = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] flat_injected                  = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] force_config_drive             = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] force_raw_images               = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] graceful_shutdown_timeout      = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] heal_instance_info_cache_interval = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] host                           = user {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_build_timeout         = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_delete_interval       = 300 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_format                = [instance: %(uuid)s]  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_name_template         = instance-%08x {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_usage_audit           = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_usage_audit_period    = month {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] internal_service_availability_zone = internal {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] key                            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] live_migration_retry_count     = 30 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_config_append              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_dir                        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_file                       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_options                    = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_rotate_interval            = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_rotate_interval_type       = days {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] log_rotation_type              = none {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] long_rpc_timeout               = 1800 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] max_concurrent_builds          = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] max_concurrent_live_migrations = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] max_concurrent_snapshots       = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] max_local_block_devices        = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] max_logfile_count              = 30 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] max_logfile_size_mb            = 200 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] maximum_instance_delete_attempts = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metadata_listen                = 0.0.0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metadata_listen_port           = 8775 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metadata_workers               = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] migrate_max_retries            = -1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] mkisofs_cmd                    = genisoimage {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] my_ip                          = 10.0.0.210 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] network_allocate_retries       = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] osapi_compute_listen_port      = 8774 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] osapi_compute_unique_server_name_scope =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] osapi_compute_workers          = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] password_length                = 12 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] periodic_enable                = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] periodic_fuzzy_delay           = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] pointer_model                  = ps2mouse {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] preallocate_images             = none {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] publish_errors                 = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] pybasedir                      = /opt/stack/nova {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ram_allocation_ratio           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rate_limit_burst               = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rate_limit_except_level        = CRITICAL {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rate_limit_interval            = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reboot_timeout                 = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reclaim_instance_interval      = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] record                         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reimage_timeout_per_gb         = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] report_interval                = 120 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rescue_timeout                 = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reserved_host_cpus             = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reserved_host_disk_mb          = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reserved_host_memory_mb        = 512 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] reserved_huge_pages            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] resize_confirm_window          = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] resize_fs_using_block_device   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] resume_guests_state_on_host_boot = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rpc_response_timeout           = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] run_external_periodic_tasks    = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] running_deleted_instance_action = reap {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] running_deleted_instance_poll_interval = 1800 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] running_deleted_instance_timeout = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler_instance_sync_interval = 120 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_down_time              = 720 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] servicegroup_driver            = db {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] shelved_offload_time           = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] shelved_poll_interval          = 3600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] shutdown_timeout               = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] source_is_ipv6                 = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ssl_only                       = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] state_path                     = /opt/stack/data/nova {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] sync_power_state_interval      = 600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] sync_power_state_pool_size     = 1000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] syslog_log_facility            = LOG_USER {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] tempdir                        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] timeout_nbd                    = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] transport_url                  = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] update_resources_interval      = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_cow_images                 = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_eventlog                   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_journal                    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_json                       = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_rootwrap_daemon            = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_stderr                     = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] use_syslog                     = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vcpu_pin_set                   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plugging_is_fatal          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plugging_timeout           = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] virt_mkfs                      = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] volume_usage_poll_interval     = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] watch_log_file                 = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] web                            = /usr/share/spice-html5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_concurrency.disable_process_locking = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.auth_strategy              = keystone {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.compute_link_prefix        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.dhcp_domain                = novalocal {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.enable_instance_password   = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.glance_link_prefix         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.instance_list_per_project_cells = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.list_records_by_skipping_down_cells = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.local_metadata_per_cell    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.max_limit                  = 1000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.metadata_cache_expiration  = 15 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.neutron_default_tenant_id  = default {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.use_forwarded_for          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.use_neutron_default_nets   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_dynamic_targets = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_jsonfile_path   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.backend                  = dogpile.cache.memcached {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.backend_argument         = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.config_prefix            = cache.oslo {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.dead_timeout             = 60.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.debug_cache_backend      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.enable_retry_client      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.enable_socket_keepalive  = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.enabled                  = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.expiration_time          = 600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.hashclient_retry_attempts = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_dead_retry      = 300 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_password        =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_pool_maxsize    = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_sasl_enabled    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.memcache_username        =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.proxies                  = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.retry_attempts           = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.retry_delay              = 0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.socket_keepalive_count   = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.socket_keepalive_idle    = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.socket_keepalive_interval = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.tls_allowed_ciphers      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.tls_cafile               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.tls_certfile             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.tls_enabled              = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cache.tls_keyfile              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.auth_section            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.auth_type               = password {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.cafile                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.certfile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.collect_timing          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.cross_az_attach         = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.debug                   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.endpoint_template       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.http_retries            = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.insecure                = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.keyfile                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.os_region_name          = RegionOne {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.split_loggers           = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cinder.timeout                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.cpu_dedicated_set      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.cpu_shared_set         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.image_type_exclude_list = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.max_concurrent_disk_ops = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.max_disk_devices_to_attach = -1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.resource_provider_association_refresh = 300 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.shutdown_retry_interval = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] conductor.workers              = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] console.allowed_origins        = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] console.ssl_ciphers            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] console.ssl_minimum_version    = default {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] consoleauth.token_ttl          = 600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.cafile                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.certfile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.collect_timing          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.connect_retries         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.connect_retry_delay     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.endpoint_override       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.insecure                = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.keyfile                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.max_version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.min_version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.region_name             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.service_name            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.service_type            = accelerator {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.split_loggers           = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.status_code_retries     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.timeout                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] cyborg.version                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.backend               = sqlalchemy {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.connection            = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.connection_debug      = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.connection_parameters =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.connection_recycle_time = 3600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.connection_trace      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.db_inc_retry_interval = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.db_max_retries        = 20 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.db_max_retry_interval = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.db_retry_interval     = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.max_overflow          = 50 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.max_pool_size         = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.max_retries           = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.mysql_wsrep_sync_wait = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.pool_timeout          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.retry_interval        = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.slave_connection      = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] database.sqlite_synchronous    = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.backend           = sqlalchemy {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.connection        = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.connection_debug  = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.connection_parameters =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.connection_recycle_time = 3600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.connection_trace  = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.db_inc_retry_interval = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.db_max_retries    = 20 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.db_max_retry_interval = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.db_retry_interval = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.max_overflow      = 50 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.max_pool_size     = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.max_retries       = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.pool_timeout      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.retry_interval    = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.slave_connection  = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] api_database.sqlite_synchronous = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] devices.enabled_mdev_types     = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ephemeral_storage_encryption.enabled = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.api_servers             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.cafile                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.certfile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.collect_timing          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.connect_retries         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.connect_retry_delay     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.debug                   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.default_trusted_certificate_ids = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.enable_certificate_validation = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.enable_rbd_download     = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.endpoint_override       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.insecure                = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.keyfile                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.max_version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.min_version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.num_retries             = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.rbd_ceph_conf           =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.rbd_connect_timeout     = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.rbd_pool                =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.rbd_user                =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.region_name             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.service_name            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.service_type            = image {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.split_loggers           = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.status_code_retries     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.timeout                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.verify_glance_signatures = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] glance.version                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] guestfs.debug                  = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.config_drive_cdrom      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.config_drive_inject_password = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.enable_instance_metrics_collection = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.enable_remotefx         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.instances_path_share    =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.iscsi_initiator_list    = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.limit_cpu_features      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.power_state_check_timeframe = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.use_multipath_io        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.volume_attach_retry_count = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.vswitch_name            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] mks.enabled                    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] image_cache.manager_interval   = 2400 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] image_cache.precache_concurrency = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] image_cache.remove_unused_base_images = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] image_cache.subdirectory_name  = _base {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.api_max_retries         = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.api_retry_interval      = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.auth_section            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.auth_type               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.cafile                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.certfile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.collect_timing          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.conductor_group         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.connect_retries         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.connect_retry_delay     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.endpoint_override       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.insecure                = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.keyfile                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.max_version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.min_version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.peer_list               = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.region_name             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.serial_console_state_timeout = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.service_name            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.service_type            = baremetal {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.split_loggers           = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.status_code_retries     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.timeout                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ironic.version                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] key_manager.fixed_key          = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.barbican_api_version  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.barbican_endpoint     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.barbican_endpoint_type = public {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.barbican_region_name  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:34 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.cafile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.certfile              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.collect_timing        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.insecure              = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.keyfile               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.number_of_retries     = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.retry_delay           = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.send_service_user_token = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.split_loggers         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.timeout               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.verify_ssl            = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican.verify_ssl_path       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.auth_section = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.auth_type = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.cafile   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.certfile = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.collect_timing = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.insecure = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.keyfile  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.split_loggers = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] barbican_service_user.timeout  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.approle_role_id          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.approle_secret_id        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.cafile                   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.certfile                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.collect_timing           = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.insecure                 = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.keyfile                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.kv_mountpoint            = secret {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.kv_path                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.kv_version               = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.namespace                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.root_token_id            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.split_loggers            = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.ssl_ca_crt_file          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.timeout                  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.use_ssl                  = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.auth_section          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.auth_type             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.cafile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.certfile              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.collect_timing        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.connect_retries       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.connect_retry_delay   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.endpoint_override     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.insecure              = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.keyfile               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.max_version           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.min_version           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.region_name           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.service_name          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.service_type          = identity {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.split_loggers         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.status_code_retries   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.timeout               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] keystone.version               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.connection_uri         =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_mode               = custom {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: WARNING oslo_config.cfg [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_power_governor_high = performance {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_power_governor_low = powersave {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_power_management   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.device_detach_attempts = 8 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.device_detach_timeout  = 20 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.disk_cachemodes        = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.disk_prefix            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.enabled_perf_events    = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.file_backed_memory     = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.gid_maps               = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.hw_disk_discard        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.hw_machine_type        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_rbd_glance_store_name =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_rbd_pool        = rbd {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_type            = default {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.images_volume_group    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.inject_key             = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.inject_partition       = -2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.inject_password        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.iscsi_iface            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.iser_use_multipath     = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_bandwidth = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_downtime = 500 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_inbound_addr = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_permit_post_copy = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_scheme  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_timeout_action = abort {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_tunnelled = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: WARNING oslo_config.cfg [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 05 13:34:35 user nova-compute[75233]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 05 13:34:35 user nova-compute[75233]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 05 13:34:35 user nova-compute[75233]: and ``live_migration_inbound_addr`` respectively.
Dec 05 13:34:35 user nova-compute[75233]: ).  Its value may be silently ignored in the future.
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.live_migration_with_native_tls = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.max_queues             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.migration_inbound_addr = 10.0.0.210 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.nfs_mount_options      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.num_memory_encrypted_guests = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.num_pcie_ports         = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.pmem_namespaces        = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.quobyte_client_cfg     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rbd_secret_uuid        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rbd_user               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.remote_filesystem_transport = ssh {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rescue_image_id        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rescue_kernel_id       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rescue_ramdisk_id      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.rx_queue_size          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.smbfs_mount_options    =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.snapshot_compression   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.snapshot_image_format  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.sparse_logical_volumes = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.swtpm_enabled          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.swtpm_group            = tss {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.swtpm_user             = tss {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.sysinfo_serial         = unique {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.tb_cache_size          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.tx_queue_size          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.uid_maps               = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.use_virtio_for_bridges = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.virt_type              = kvm {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.volume_clear           = zero {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.volume_clear_size      = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.volume_use_multipath   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_cache_path   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.vzstorage_mount_user   = stack {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.auth_section           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.auth_type              = password {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.cafile                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.certfile               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.collect_timing         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.connect_retries        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.connect_retry_delay    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.default_floating_pool  = public {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.endpoint_override      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.extension_sync_interval = 600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.http_retries           = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.insecure               = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.keyfile                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.max_version            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.min_version            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.ovs_bridge             = br-int {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.physnets               = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.region_name            = RegionOne {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.service_metadata_proxy = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.service_name           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.service_type           = network {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.split_loggers          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.status_code_retries    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.timeout                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] neutron.version                = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] notifications.bdms_in_notifications = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] notifications.default_level    = INFO {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] notifications.notification_format = unversioned {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] notifications.notify_on_state_change = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] pci.alias                      = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] pci.device_spec                = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] pci.report_in_placement        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.auth_section         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.auth_type            = password {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.cafile               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.certfile             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.collect_timing       = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.connect_retries      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.connect_retry_delay  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.default_domain_id    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.default_domain_name  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.domain_id            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.domain_name          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.endpoint_override    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.insecure             = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.keyfile              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.max_version          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.min_version          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.password             = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.project_domain_id    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.project_domain_name  = Default {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.project_id           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.project_name         = service {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.region_name          = RegionOne {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.service_name         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.service_type         = placement {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.split_loggers        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.status_code_retries  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.system_scope         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.timeout              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.trust_id             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.user_domain_id       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.user_domain_name     = Default {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.user_id              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.username             = placement {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] placement.version              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.cores                    = 20 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.count_usage_from_placement = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.injected_file_content_bytes = 10240 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.injected_file_path_length = 255 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.injected_files           = 5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.instances                = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.key_pairs                = 100 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.metadata_items           = 128 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.ram                      = 51200 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.recheck_quota            = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.server_group_members     = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] quota.server_groups            = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rdp.enabled                    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.image_metadata_prefilter = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.max_attempts         = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.max_placement_results = 1000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.query_placement_for_image_type_support = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] scheduler.workers              = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.host_subset_size = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.isolated_hosts = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.isolated_images = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.pci_in_placement = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.track_instance_changes = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metrics.required               = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metrics.weight_multiplier      = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] metrics.weight_setting         = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] serial_console.enabled         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] serial_console.port_range      = 10000:20000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] serial_console.serialproxy_port = 6083 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.auth_section      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.auth_type         = password {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.cafile            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.certfile          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.collect_timing    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.insecure          = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.keyfile           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.send_service_user_token = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.split_loggers     = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] service_user.timeout           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.agent_enabled            = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.enabled                  = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.html5proxy_port          = 6082 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.image_compression        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.jpeg_compression         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.playback_compression     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.server_listen            = 127.0.0.1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.streaming_mode           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] spice.zlib_compression         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] upgrade_levels.baseapi         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] upgrade_levels.compute         = auto {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] upgrade_levels.conductor       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] upgrade_levels.scheduler       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.auth_section = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.auth_type = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.cafile = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.certfile = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.insecure = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.keyfile = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vendordata_dynamic_auth.timeout = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.api_retry_count         = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.ca_file                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.cache_prefix            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.cluster_name            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.connection_pool_size    = 10 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.console_delay_seconds   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.datastore_regex         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.host_ip                 = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.host_password           = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.host_port               = 443 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.host_username           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.insecure                = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.integration_bridge      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.maximum_objects         = 100 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.pbm_default_policy      = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.pbm_enabled             = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.pbm_wsdl_location       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.serial_port_proxy_uri   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.serial_port_service_uri = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.task_poll_interval      = 0.5 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.use_linked_clone        = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.vnc_keymap              = en-us {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.vnc_port                = 5900 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vmware.vnc_port_total          = 10000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.auth_schemes               = ['none'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.enabled                    = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.novncproxy_port            = 6080 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.server_listen              = 0.0.0.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.vencrypt_ca_certs          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.vencrypt_client_cert       = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vnc.vencrypt_client_key        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.disable_rootwrap   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.enable_numa_live_migration = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.libvirt_disable_apic = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.client_socket_timeout     = 900 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.default_pool_size         = 1000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.keep_alive                = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.max_header_line           = 16384 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.ssl_ca_file               = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.ssl_cert_file             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.ssl_key_file              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.tcp_keepidle              = 600 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] zvm.ca_file                    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] zvm.cloud_connector_url        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] zvm.reachable_timeout          = 300 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.enforce_new_defaults = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.enforce_scope      = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.policy_default_rule = default {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.policy_file        = policy.yaml {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.connection_string     = messaging:// {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.enabled               = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.es_doc_type           = notification {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.es_scroll_size        = 10000 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.es_scroll_time        = 2m {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.filter_error_trace    = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.hmac_keys             = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.sentinel_service_name = mymaster {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.socket_timeout        = 0.1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.trace_requests        = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler.trace_sqlalchemy      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler_jaeger.process_tags   = {} {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler_jaeger.service_name_prefix = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] profiler_otlp.service_name_prefix = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] remote_debug.host              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] remote_debug.port              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.ssl      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_notifications.retry = -1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.auth_section        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.auth_type           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.cafile              = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.certfile            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.collect_timing      = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.connect_retries     = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.connect_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.endpoint_id         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.endpoint_override   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.insecure            = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.keyfile             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.max_version         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.min_version         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.region_name         = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.service_name        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.service_type        = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.split_loggers       = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.status_code_retries = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.status_code_retry_delay = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.timeout             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.valid_interfaces    = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_limit.version             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_reports.file_event_handler = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] oslo_reports.log_dir           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_ovs_privileged.group  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] vif_plug_ovs_privileged.user   = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.flat_interface = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.isolate_vif         = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_vif_ovs.per_port_bridge     = False {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] os_brick.lock_path             = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] privsep_osbrick.capabilities   = [21] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] privsep_osbrick.group          = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] privsep_osbrick.helper_command = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] privsep_osbrick.user           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] nova_sys_admin.group           = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] nova_sys_admin.helper_command  = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] nova_sys_admin.user            = None {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG oslo_service.service [None req-36c52d41-4eae-4fbb-8d8c-55551be3fd9d None None] ******************************************************************************** {{(pid=75233) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 05 13:34:35 user nova-compute[75233]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Connecting to libvirt: qemu:///system {{(pid=75233) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9f6160a530> {{(pid=75233) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 05 13:34:35 user nova-compute[75233]: libvirt:  error : internal error: could not initialize domain event timer
Dec 05 13:34:35 user nova-compute[75233]: WARNING nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9f6160a530> {{(pid=75233) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Starting native event thread {{(pid=75233) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Starting green dispatch thread {{(pid=75233) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Starting connection event dispatch thread {{(pid=75233) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 05 13:34:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Connection event '1' reason 'None'
Dec 05 13:34:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 05 13:34:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.mount [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Initialising _HostMountState generation 0 {{(pid=75233) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 05 13:34:42 user nova-compute[75233]: INFO nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host capabilities <capabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <host>
Dec 05 13:34:42 user nova-compute[75233]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 05 13:34:42 user nova-compute[75233]:     <cpu>
Dec 05 13:34:42 user nova-compute[75233]:       <arch>x86_64</arch>
Dec 05 13:34:42 user nova-compute[75233]:       <model>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <microcode version='1070'/>
Dec 05 13:34:42 user nova-compute[75233]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='osxsave'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='invtsc'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='rsba'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature name='skip-l1dfl-vmentry'/>
Dec 05 13:34:42 user nova-compute[75233]:       <pages unit='KiB' size='4'/>
Dec 05 13:34:42 user nova-compute[75233]:       <pages unit='KiB' size='2048'/>
Dec 05 13:34:42 user nova-compute[75233]:     </cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <power_management>
Dec 05 13:34:42 user nova-compute[75233]:       <suspend_mem/>
Dec 05 13:34:42 user nova-compute[75233]:       <suspend_disk/>
Dec 05 13:34:42 user nova-compute[75233]:       <suspend_hybrid/>
Dec 05 13:34:42 user nova-compute[75233]:     </power_management>
Dec 05 13:34:42 user nova-compute[75233]:     <iommu support='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <migration_features>
Dec 05 13:34:42 user nova-compute[75233]:       <live/>
Dec 05 13:34:42 user nova-compute[75233]:       <uri_transports>
Dec 05 13:34:42 user nova-compute[75233]:         <uri_transport>tcp</uri_transport>
Dec 05 13:34:42 user nova-compute[75233]:         <uri_transport>rdma</uri_transport>
Dec 05 13:34:42 user nova-compute[75233]:       </uri_transports>
Dec 05 13:34:42 user nova-compute[75233]:     </migration_features>
Dec 05 13:34:42 user nova-compute[75233]:     <topology>
Dec 05 13:34:42 user nova-compute[75233]:       <cells num='2'>
Dec 05 13:34:42 user nova-compute[75233]:         <cell id='0'>
Dec 05 13:34:42 user nova-compute[75233]:           <memory unit='KiB'>8140616</memory>
Dec 05 13:34:42 user nova-compute[75233]:           <pages unit='KiB' size='4'>2035154</pages>
Dec 05 13:34:42 user nova-compute[75233]:           <pages unit='KiB' size='2048'>0</pages>
Dec 05 13:34:42 user nova-compute[75233]:           <distances>
Dec 05 13:34:42 user nova-compute[75233]:             <sibling id='0' value='10'/>
Dec 05 13:34:42 user nova-compute[75233]:             <sibling id='1' value='20'/>
Dec 05 13:34:42 user nova-compute[75233]:           </distances>
Dec 05 13:34:42 user nova-compute[75233]:           <cpus num='6'>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 05 13:34:42 user nova-compute[75233]:           </cpus>
Dec 05 13:34:42 user nova-compute[75233]:         </cell>
Dec 05 13:34:42 user nova-compute[75233]:         <cell id='1'>
Dec 05 13:34:42 user nova-compute[75233]:           <memory unit='KiB'>8255068</memory>
Dec 05 13:34:42 user nova-compute[75233]:           <pages unit='KiB' size='4'>2063767</pages>
Dec 05 13:34:42 user nova-compute[75233]:           <pages unit='KiB' size='2048'>0</pages>
Dec 05 13:34:42 user nova-compute[75233]:           <distances>
Dec 05 13:34:42 user nova-compute[75233]:             <sibling id='0' value='20'/>
Dec 05 13:34:42 user nova-compute[75233]:             <sibling id='1' value='10'/>
Dec 05 13:34:42 user nova-compute[75233]:           </distances>
Dec 05 13:34:42 user nova-compute[75233]:           <cpus num='6'>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 05 13:34:42 user nova-compute[75233]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 05 13:34:42 user nova-compute[75233]:           </cpus>
Dec 05 13:34:42 user nova-compute[75233]:         </cell>
Dec 05 13:34:42 user nova-compute[75233]:       </cells>
Dec 05 13:34:42 user nova-compute[75233]:     </topology>
Dec 05 13:34:42 user nova-compute[75233]:     <cache>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 05 13:34:42 user nova-compute[75233]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 05 13:34:42 user nova-compute[75233]:     </cache>
Dec 05 13:34:42 user nova-compute[75233]:     <secmodel>
Dec 05 13:34:42 user nova-compute[75233]:       <model>apparmor</model>
Dec 05 13:34:42 user nova-compute[75233]:       <doi>0</doi>
Dec 05 13:34:42 user nova-compute[75233]:     </secmodel>
Dec 05 13:34:42 user nova-compute[75233]:     <secmodel>
Dec 05 13:34:42 user nova-compute[75233]:       <model>dac</model>
Dec 05 13:34:42 user nova-compute[75233]:       <doi>0</doi>
Dec 05 13:34:42 user nova-compute[75233]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 05 13:34:42 user nova-compute[75233]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 05 13:34:42 user nova-compute[75233]:     </secmodel>
Dec 05 13:34:42 user nova-compute[75233]:   </host>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='alpha'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>clipper</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='armv6l'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>spitz</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>nuri</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>kzm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sx1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>z2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>tosa</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>n810</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>n800</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>terrier</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>midway</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>microbit</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>verdex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>highbank</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>akita</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>connex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>collie</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='armv7l'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>spitz</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>nuri</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>kzm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sx1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>z2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>tosa</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>n810</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>n800</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>terrier</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>midway</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>microbit</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>verdex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>highbank</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>akita</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>connex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>collie</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='aarch64'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>spitz</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>nuri</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>kzm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sx1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>z2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>tosa</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>n810</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>n800</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>terrier</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>midway</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>microbit</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>verdex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>raspi3b</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>highbank</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>akita</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>connex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>collie</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <acpi default='on' toggle='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='cris'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='i686'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>x-remote</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>isapc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>microvm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='kvm'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <pae/>
Dec 05 13:34:42 user nova-compute[75233]:       <nonpae/>
Dec 05 13:34:42 user nova-compute[75233]:       <acpi default='on' toggle='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:       <apic default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='m68k'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>an5206</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>q800</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>next-cube</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='microblaze'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='microblazeel'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='mips'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='16'>malta</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='mipsel'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='16'>malta</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='mips64'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='16'>malta</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>pica61</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>magnum</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='mips64el'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='16'>malta</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>pica61</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>magnum</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='16'>boston</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='ppc'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mac99</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>40p</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>taihu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='ppc64'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2048'>powernv9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>taihu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2048'>powernv10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>40p</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mac99</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2048'>powernv8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='ppc64le'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2048'>powernv9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>taihu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2048'>powernv10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>40p</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>mac99</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2048'>powernv8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='riscv32'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='8'>spike</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>opentitan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='5'>sifive_u</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sifive_e</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='8'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='riscv64'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='8'>spike</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='5'>sifive_u</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>shakti_c</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sifive_e</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='8'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='s390x'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='sh4'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>shix</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>r2d</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='sh4eb'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>shix</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>r2d</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='sparc'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>SS-5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>SS-20</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>LX</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>SS-4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>SS-10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>Voyager</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='sparc64'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sun4u</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>niagara</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>sun4v</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='x86_64'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>64</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>x-remote</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='1'>isapc</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>microvm</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='kvm'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <acpi default='on' toggle='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:       <apic default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='xtensa'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>sim</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>kc705</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ml605</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx200</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx60</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]:   <guest>
Dec 05 13:34:42 user nova-compute[75233]:     <os_type>hvm</os_type>
Dec 05 13:34:42 user nova-compute[75233]:     <arch name='xtensaeb'>
Dec 05 13:34:42 user nova-compute[75233]:       <wordsize>32</wordsize>
Dec 05 13:34:42 user nova-compute[75233]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='4'>sim</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>kc705</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ml605</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>virt</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx200</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>lx60</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 05 13:34:42 user nova-compute[75233]:       <domain type='qemu'/>
Dec 05 13:34:42 user nova-compute[75233]:     </arch>
Dec 05 13:34:42 user nova-compute[75233]:     <features>
Dec 05 13:34:42 user nova-compute[75233]:       <cpuselection/>
Dec 05 13:34:42 user nova-compute[75233]:       <deviceboot/>
Dec 05 13:34:42 user nova-compute[75233]:       <disksnapshot default='on' toggle='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     </features>
Dec 05 13:34:42 user nova-compute[75233]:   </guest>
Dec 05 13:34:42 user nova-compute[75233]: </capabilities>
Dec 05 13:34:42 user nova-compute[75233]: 
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-i440fx-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>i686</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='255'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'/>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='lm'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ide</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-i440fx-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>i686</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='255'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'/>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='lm'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ide</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-q35-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>i686</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='288'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'/>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='lm'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-q35-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>i686</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='288'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'/>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='lm'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-i440fx-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>x86_64</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='255'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>efi</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='invtsc'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='rsba'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ide</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-i440fx-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>x86_64</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='255'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>efi</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='invtsc'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='rsba'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ide</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-q35-jammy</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>x86_64</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='288'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>efi</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='invtsc'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='rsba'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 05 13:34:42 user nova-compute[75233]: <domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 13:34:42 user nova-compute[75233]:   <domain>kvm</domain>
Dec 05 13:34:42 user nova-compute[75233]:   <machine>pc-q35-6.2</machine>
Dec 05 13:34:42 user nova-compute[75233]:   <arch>x86_64</arch>
Dec 05 13:34:42 user nova-compute[75233]:   <vcpu max='288'/>
Dec 05 13:34:42 user nova-compute[75233]:   <iothreads supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:   <os supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='firmware'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>efi</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:     <loader supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>rom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pflash</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='readonly'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='secure'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>yes</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>no</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </loader>
Dec 05 13:34:42 user nova-compute[75233]:   </os>
Dec 05 13:34:42 user nova-compute[75233]:   <cpu>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-passthrough' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='hostPassthroughMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='maximum' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='maximumMigratable'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>on</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>off</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='host-model' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <vendor>Intel</vendor>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ss'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='vmx'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pcid'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='hypervisor'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arat'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='umip'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='md-clear'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='invtsc'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibpb'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='ibrs'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-stibp'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='rsba'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='erms'/>
Dec 05 13:34:42 user nova-compute[75233]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:     <mode name='custom' supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>qemu64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>qemu32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>phenom</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>pentium</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>n270</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm64</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>kvm32</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>coreduo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>core2duo</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>athlon</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Westmere</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Snowridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Skylake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>SandyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Penryn</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G5</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G4</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G3</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Opteron_G2</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Opteron_G1</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>IvyBridge</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Icelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Haswell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Rome</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-Milan</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>EPYC</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Dhyana</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cooperlake</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>Conroe</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='no'>Broadwell</model>
Dec 05 13:34:42 user nova-compute[75233]:       <model usable='yes'>486</model>
Dec 05 13:34:42 user nova-compute[75233]:     </mode>
Dec 05 13:34:42 user nova-compute[75233]:   </cpu>
Dec 05 13:34:42 user nova-compute[75233]:   <memoryBacking supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:     <enum name='sourceType'>
Dec 05 13:34:42 user nova-compute[75233]:       <value>file</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>anonymous</value>
Dec 05 13:34:42 user nova-compute[75233]:       <value>memfd</value>
Dec 05 13:34:42 user nova-compute[75233]:     </enum>
Dec 05 13:34:42 user nova-compute[75233]:   </memoryBacking>
Dec 05 13:34:42 user nova-compute[75233]:   <devices>
Dec 05 13:34:42 user nova-compute[75233]:     <disk supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='diskDevice'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>disk</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cdrom</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>floppy</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>lun</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='bus'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>fdc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sata</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </disk>
Dec 05 13:34:42 user nova-compute[75233]:     <graphics supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='type'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>sdl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vnc</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>spice</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egl-headless</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </graphics>
Dec 05 13:34:42 user nova-compute[75233]:     <video supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='modelType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>cirrus</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>vmvga</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>qxl</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>none</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>bochs</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>ramfb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </video>
Dec 05 13:34:42 user nova-compute[75233]:     <hostdev supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='mode'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>subsystem</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='startupPolicy'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>default</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>mandatory</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>requisite</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>optional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='subsysType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>usb</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>pci</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>scsi</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='capsType'/>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='pciBackend'/>
Dec 05 13:34:42 user nova-compute[75233]:     </hostdev>
Dec 05 13:34:42 user nova-compute[75233]:     <rng supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtio-non-transitional</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>random</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>egd</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>builtin</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </rng>
Dec 05 13:34:42 user nova-compute[75233]:     <filesystem supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='driverType'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>path</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>handle</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>virtiofs</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </filesystem>
Dec 05 13:34:42 user nova-compute[75233]:     <tpm supported='yes'>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='model'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-tis</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>tpm-crb</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:       <enum name='backendModel'>
Dec 05 13:34:42 user nova-compute[75233]:         <value>passthrough</value>
Dec 05 13:34:42 user nova-compute[75233]:         <value>emulator</value>
Dec 05 13:34:42 user nova-compute[75233]:       </enum>
Dec 05 13:34:42 user nova-compute[75233]:     </tpm>
Dec 05 13:34:42 user nova-compute[75233]:   </devices>
Dec 05 13:34:42 user nova-compute[75233]:   <features>
Dec 05 13:34:42 user nova-compute[75233]:     <gic supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:     <vmcoreinfo supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <genid supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backingStoreInput supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <backup supported='yes'/>
Dec 05 13:34:42 user nova-compute[75233]:     <sev supported='no'/>
Dec 05 13:34:42 user nova-compute[75233]:   </features>
Dec 05 13:34:42 user nova-compute[75233]: </domainCapabilities>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75233) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75233) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Checking secure boot support for host arch (x86_64) {{(pid=75233) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Checking secure boot support for host arch (x86_64) {{(pid=75233) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Checking secure boot support for host arch (x86_64) {{(pid=75233) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Checking secure boot support for host arch (x86_64) {{(pid=75233) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Checking secure boot support for host arch (x86_64) {{(pid=75233) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 13:34:42 user nova-compute[75233]: INFO nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Secure Boot support detected
Dec 05 13:34:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] cpu compare xml: <cpu match="exact">
Dec 05 13:34:42 user nova-compute[75233]:   <model>Nehalem</model>
Dec 05 13:34:42 user nova-compute[75233]: </cpu>
Dec 05 13:34:42 user nova-compute[75233]:  {{(pid=75233) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10025}}
Dec 05 13:34:42 user nova-compute[75233]: INFO nova.virt.node [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Generated node identity fdab8c34-39de-4e1a-b763-0eb01d8e8585
Dec 05 13:34:42 user nova-compute[75233]: INFO nova.virt.node [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Wrote node identity fdab8c34-39de-4e1a-b763-0eb01d8e8585 to /opt/stack/data/nova/compute_id
Dec 05 13:34:43 user nova-compute[75233]: WARNING nova.compute.manager [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Compute nodes ['fdab8c34-39de-4e1a-b763-0eb01d8e8585'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 05 13:34:43 user nova-compute[75233]: INFO nova.compute.manager [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 05 13:34:43 user nova-compute[75233]: WARNING nova.compute.manager [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 05 13:34:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:34:43 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:34:43 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Hypervisor/Node resource view: name=user free_ram=10939MB free_disk=26.116195678710938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:34:43 user nova-compute[75233]: WARNING nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] No compute node record for user:fdab8c34-39de-4e1a-b763-0eb01d8e8585: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fdab8c34-39de-4e1a-b763-0eb01d8e8585 could not be found.
Dec 05 13:34:43 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Compute node record created for user:user with uuid: fdab8c34-39de-4e1a-b763-0eb01d8e8585
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:34:43 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] [req-1d70e9d0-bcfd-4716-8d4a-24ec8a55a54d] Created resource provider record via placement API for resource provider with UUID fdab8c34-39de-4e1a-b763-0eb01d8e8585 and name user.
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75233) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 05 13:34:43 user nova-compute[75233]: INFO nova.virt.libvirt.host [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] kernel doesn't support AMD SEV
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Libvirt baseline CPU <cpu>
Dec 05 13:34:43 user nova-compute[75233]:   <arch>x86_64</arch>
Dec 05 13:34:43 user nova-compute[75233]:   <model>Nehalem</model>
Dec 05 13:34:43 user nova-compute[75233]:   <vendor>Intel</vendor>
Dec 05 13:34:43 user nova-compute[75233]:   <topology sockets="6" cores="1" threads="1"/>
Dec 05 13:34:43 user nova-compute[75233]: </cpu>
Dec 05 13:34:43 user nova-compute[75233]:  {{(pid=75233) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12524}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Updated inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Updating resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 generation from 0 to 1 during operation: update_inventory {{(pid=75233) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 05 13:34:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:34:44 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Updating resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 generation from 1 to 2 during operation: update_traits {{(pid=75233) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 05 13:34:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:34:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:34:44 user nova-compute[75233]: DEBUG nova.service [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Creating RPC server for service compute {{(pid=75233) start /opt/stack/nova/nova/service.py:182}}
Dec 05 13:34:44 user nova-compute[75233]: DEBUG nova.service [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] Join ServiceGroup membership for this service compute {{(pid=75233) start /opt/stack/nova/nova/service.py:199}}
Dec 05 13:34:44 user nova-compute[75233]: DEBUG nova.servicegroup.drivers.db [None req-df3b0865-4470-4a14-8101-7c9af21cb94f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75233) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 05 13:35:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:35:34 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:35:34 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=10369MB free_disk=25.878890991210938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:35:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:35:35 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:35:35 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:35:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:35:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:36:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:36:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:36:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=10303MB free_disk=25.943359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:36:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:36:36 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:36:36 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:36:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:36:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:36:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:37:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:37:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=25.695606231689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:37:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:37:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:37:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:37:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:37:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 13:37:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:37:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:38:36 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:38:36 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=9616MB free_disk=25.716304779052734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:38:37 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:38:37 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:38:37 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:38:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:38:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:38:39 user nova-compute[75233]: INFO nova.compute.claims [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Claim successful on node user
Dec 05 13:38:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.811s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:38:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:38:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Creating image(s)
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Skipping network cache update for instance because it is Building. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:40 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:38:40 user nova-compute[75233]: INFO nova.compute.claims [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Claim successful on node user
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.policy [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7ddf7a828a547e9b606ed9e8e8727eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b7c3d1e9a7462b8c4833174777873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:38:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.virt.images [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] b4dfffde-9cf2-443d-89c3-b4ad40b1f06e was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.part /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.policy [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7ddf7a828a547e9b606ed9e8e8727eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b7c3d1e9a7462b8c4833174777873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.part /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.converted" returned: 0 in 0.149s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:38:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Creating image(s)
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.384s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:41 user nova-compute[75233]: INFO oslo.privsep.daemon [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptbe7_248/privsep.sock']
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.140s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:42 user sudo[84905]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptbe7_248/privsep.sock
Dec 05 13:38:42 user sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 13:38:43 user sudo[84905]: pam_unix(sudo:session): session closed for user root
Dec 05 13:38:43 user nova-compute[75233]: INFO oslo.privsep.daemon [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Spawned new privsep daemon via rootwrap
Dec 05 13:38:43 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 13:38:43 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 13:38:43 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 05 13:38:43 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84909
Dec 05 13:38:43 user nova-compute[75233]: WARNING oslo_privsep.priv_context [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] privsep daemon already running
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Successfully created port: e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Successfully created port: 452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk 1073741824" returned: 0 in 0.041s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.229s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.204s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.206s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk 1073741824" returned: 0 in 0.045s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Cannot resize image /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Ensure instance console log exists: /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.220s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Cannot resize image /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Ensure instance console log exists: /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Successfully updated port: e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-changed-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Refreshing instance network info cache due to event network-changed-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:38:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] Acquiring lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Successfully updated port: 452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-changed-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Refreshing instance network info cache due to event network-changed-452eceed-ab34-4c46-9122-6f289fcc7597. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance network_info: |[{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] Acquired lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.neutron [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Refreshing network info cache for port e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Start _get_guest_xml network_info=[{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:38:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:38:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355690095',display_name='tempest-ServerRescueNegativeTestJSON-server-355690095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355690095',id=2,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1lgdd8ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:42Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=5164ddc7-a09d-46b5-893c-c42aad687a3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:38:47 user nova-compute[75233]: DEBUG nova.objects.instance [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'pci_devices' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:38:48 user nova-compute[75233]:   <uuid>5164ddc7-a09d-46b5-893c-c42aad687a3b</uuid>
Dec 05 13:38:48 user nova-compute[75233]:   <name>instance-00000002</name>
Dec 05 13:38:48 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:38:48 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:38:48 user nova-compute[75233]:   <metadata>
Dec 05 13:38:48 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:38:48 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-355690095</nova:name>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:38:47</nova:creationTime>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:38:48 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:38:48 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:owner>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:user uuid="e7ddf7a828a547e9b606ed9e8e8727eb">tempest-ServerRescueNegativeTestJSON-2142653953-project-member</nova:user>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:project uuid="16b7c3d1e9a7462b8c4833174777873e">tempest-ServerRescueNegativeTestJSON-2142653953</nova:project>
Dec 05 13:38:48 user nova-compute[75233]:       </nova:owner>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:ports>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:port uuid="e97d17ec-d682-4bbe-9c3b-5c12697d1e9f">
Dec 05 13:38:48 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:38:48 user nova-compute[75233]:         </nova:port>
Dec 05 13:38:48 user nova-compute[75233]:       </nova:ports>
Dec 05 13:38:48 user nova-compute[75233]:     </nova:instance>
Dec 05 13:38:48 user nova-compute[75233]:   </metadata>
Dec 05 13:38:48 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:38:48 user nova-compute[75233]:     <system>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="serial">5164ddc7-a09d-46b5-893c-c42aad687a3b</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="uuid">5164ddc7-a09d-46b5-893c-c42aad687a3b</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:38:48 user nova-compute[75233]:     </system>
Dec 05 13:38:48 user nova-compute[75233]:   </sysinfo>
Dec 05 13:38:48 user nova-compute[75233]:   <os>
Dec 05 13:38:48 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:38:48 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:38:48 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:38:48 user nova-compute[75233]:   </os>
Dec 05 13:38:48 user nova-compute[75233]:   <features>
Dec 05 13:38:48 user nova-compute[75233]:     <acpi/>
Dec 05 13:38:48 user nova-compute[75233]:     <apic/>
Dec 05 13:38:48 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:38:48 user nova-compute[75233]:   </features>
Dec 05 13:38:48 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:38:48 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:38:48 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:38:48 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:38:48 user nova-compute[75233]:   </clock>
Dec 05 13:38:48 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:38:48 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:38:48 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:38:48 user nova-compute[75233]:   </cpu>
Dec 05 13:38:48 user nova-compute[75233]:   <devices>
Dec 05 13:38:48 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:38:48 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:38:48 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk"/>
Dec 05 13:38:48 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:38:48 user nova-compute[75233]:     </disk>
Dec 05 13:38:48 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:38:48 user nova-compute[75233]:       <mac address="fa:16:3e:3b:e4:87"/>
Dec 05 13:38:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:38:48 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:38:48 user nova-compute[75233]:       <target dev="tape97d17ec-d6"/>
Dec 05 13:38:48 user nova-compute[75233]:     </interface>
Dec 05 13:38:48 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:38:48 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/console.log" append="off"/>
Dec 05 13:38:48 user nova-compute[75233]:     </serial>
Dec 05 13:38:48 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:38:48 user nova-compute[75233]:     <video>
Dec 05 13:38:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:38:48 user nova-compute[75233]:     </video>
Dec 05 13:38:48 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:38:48 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:38:48 user nova-compute[75233]:     </rng>
Dec 05 13:38:48 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:38:48 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:38:48 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:38:48 user nova-compute[75233]:     </memballoon>
Dec 05 13:38:48 user nova-compute[75233]:   </devices>
Dec 05 13:38:48 user nova-compute[75233]: </domain>
Dec 05 13:38:48 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355690095',display_name='tempest-ServerRescueNegativeTestJSON-server-355690095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355690095',id=2,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1lgdd8ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:42Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=5164ddc7-a09d-46b5-893c-c42aad687a3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG os_vif [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Created schema index Interface.name {{(pid=75233) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Created schema index Port.name {{(pid=75233) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Created schema index Bridge.name {{(pid=75233) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [POLLOUT] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eae02aae-375a-5bfc-a3c6-83c059c7ec51', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:38:48 user nova-compute[75233]: INFO oslo.privsep.daemon [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpsv6_0z8q/privsep.sock']
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:38:48 user sudo[84947]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpsv6_0z8q/privsep.sock
Dec 05 13:38:48 user sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 13:38:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance network_info: |[{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Refreshing network info cache for port 452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Start _get_guest_xml network_info=[{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:38:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:38:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478206480',display_name='tempest-ServerRescueNegativeTestJSON-server-478206480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-478206480',id=1,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-p8zaf510',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:40Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=2bec11aa-9bc8-4724-8d1c-1dd2aa813dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:38:48 user nova-compute[75233]:   <uuid>2bec11aa-9bc8-4724-8d1c-1dd2aa813dda</uuid>
Dec 05 13:38:48 user nova-compute[75233]:   <name>instance-00000001</name>
Dec 05 13:38:48 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:38:48 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:38:48 user nova-compute[75233]:   <metadata>
Dec 05 13:38:48 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:38:48 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-478206480</nova:name>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:38:48</nova:creationTime>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:38:48 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:38:48 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:owner>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:user uuid="e7ddf7a828a547e9b606ed9e8e8727eb">tempest-ServerRescueNegativeTestJSON-2142653953-project-member</nova:user>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:project uuid="16b7c3d1e9a7462b8c4833174777873e">tempest-ServerRescueNegativeTestJSON-2142653953</nova:project>
Dec 05 13:38:48 user nova-compute[75233]:       </nova:owner>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:38:48 user nova-compute[75233]:       <nova:ports>
Dec 05 13:38:48 user nova-compute[75233]:         <nova:port uuid="452eceed-ab34-4c46-9122-6f289fcc7597">
Dec 05 13:38:48 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 13:38:48 user nova-compute[75233]:         </nova:port>
Dec 05 13:38:48 user nova-compute[75233]:       </nova:ports>
Dec 05 13:38:48 user nova-compute[75233]:     </nova:instance>
Dec 05 13:38:48 user nova-compute[75233]:   </metadata>
Dec 05 13:38:48 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:38:48 user nova-compute[75233]:     <system>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="serial">2bec11aa-9bc8-4724-8d1c-1dd2aa813dda</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="uuid">2bec11aa-9bc8-4724-8d1c-1dd2aa813dda</entry>
Dec 05 13:38:48 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:38:48 user nova-compute[75233]:     </system>
Dec 05 13:38:48 user nova-compute[75233]:   </sysinfo>
Dec 05 13:38:48 user nova-compute[75233]:   <os>
Dec 05 13:38:48 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:38:48 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:38:48 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:38:48 user nova-compute[75233]:   </os>
Dec 05 13:38:48 user nova-compute[75233]:   <features>
Dec 05 13:38:48 user nova-compute[75233]:     <acpi/>
Dec 05 13:38:48 user nova-compute[75233]:     <apic/>
Dec 05 13:38:48 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:38:48 user nova-compute[75233]:   </features>
Dec 05 13:38:48 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:38:48 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:38:48 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:38:48 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:38:48 user nova-compute[75233]:   </clock>
Dec 05 13:38:48 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:38:48 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:38:48 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:38:48 user nova-compute[75233]:   </cpu>
Dec 05 13:38:48 user nova-compute[75233]:   <devices>
Dec 05 13:38:48 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:38:48 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:38:48 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk"/>
Dec 05 13:38:48 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:38:48 user nova-compute[75233]:     </disk>
Dec 05 13:38:48 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:38:48 user nova-compute[75233]:       <mac address="fa:16:3e:d5:95:cc"/>
Dec 05 13:38:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:38:48 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:38:48 user nova-compute[75233]:       <target dev="tap452eceed-ab"/>
Dec 05 13:38:48 user nova-compute[75233]:     </interface>
Dec 05 13:38:48 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:38:48 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/console.log" append="off"/>
Dec 05 13:38:48 user nova-compute[75233]:     </serial>
Dec 05 13:38:48 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:38:48 user nova-compute[75233]:     <video>
Dec 05 13:38:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:38:48 user nova-compute[75233]:     </video>
Dec 05 13:38:48 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:38:48 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:38:48 user nova-compute[75233]:     </rng>
Dec 05 13:38:48 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:38:48 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:38:48 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:38:48 user nova-compute[75233]:     </memballoon>
Dec 05 13:38:48 user nova-compute[75233]:   </devices>
Dec 05 13:38:48 user nova-compute[75233]: </domain>
Dec 05 13:38:48 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478206480',display_name='tempest-ServerRescueNegativeTestJSON-server-478206480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-478206480',id=1,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-p8zaf510',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:40Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=2bec11aa-9bc8-4724-8d1c-1dd2aa813dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG os_vif [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f4d0e80-5e3e-5559-9782-ba9a03bc7590', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:38:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updated VIF entry in instance network info cache for port 452eceed-ab34-4c46-9122-6f289fcc7597. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:38:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:38:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d600d82-382e-4fc1-8de4-70806225b1e2 req-4d9790b6-4b57-487f-babd-beb365c98c25 service nova] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:38:49 user sudo[84947]: pam_unix(sudo:session): session closed for user root
Dec 05 13:38:49 user nova-compute[75233]: INFO oslo.privsep.daemon [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Spawned new privsep daemon via rootwrap
Dec 05 13:38:49 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 13:38:49 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 13:38:49 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 05 13:38:49 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84952
Dec 05 13:38:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updated VIF entry in instance network info cache for port e97d17ec-d682-4bbe-9c3b-5c12697d1e9f. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:38:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:38:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05798765-d3c4-445c-b4a1-d0e2b7815801 req-e64ad6d3-b2f2-4ed0-b13d-3ec14dcd6b15 service nova] Releasing lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:38:49 user nova-compute[75233]: WARNING oslo_privsep.priv_context [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] privsep daemon already running
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap452eceed-ab, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap452eceed-ab, col_values=(('qos', UUID('388711ea-d83c-4fee-b79c-ecbd50019c8a')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap452eceed-ab, col_values=(('external_ids', {'iface-id': '452eceed-ab34-4c46-9122-6f289fcc7597', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:95:cc', 'vm-uuid': '2bec11aa-9bc8-4724-8d1c-1dd2aa813dda'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:50 user nova-compute[75233]: INFO os_vif [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab')
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape97d17ec-d6, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape97d17ec-d6, col_values=(('qos', UUID('9e7cdf5a-970e-4909-aae6-02380b586c50')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape97d17ec-d6, col_values=(('external_ids', {'iface-id': 'e97d17ec-d682-4bbe-9c3b-5c12697d1e9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:e4:87', 'vm-uuid': '5164ddc7-a09d-46b5-893c-c42aad687a3b'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:50 user nova-compute[75233]: INFO os_vif [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6')
Dec 05 13:38:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:d5:95:cc, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:38:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:3b:e4:87, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:38:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:38:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance spawned successfully.
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:38:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance spawned successfully.
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:38:54 user nova-compute[75233]: INFO nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Took 13.14 seconds to spawn the instance on the hypervisor.
Dec 05 13:38:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:38:55 user nova-compute[75233]: INFO nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Took 14.45 seconds to spawn the instance on the hypervisor.
Dec 05 13:38:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:38:55 user nova-compute[75233]: INFO nova.compute.manager [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Took 14.37 seconds to build instance.
Dec 05 13:38:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3167b69c-67a8-44b6-81fc-c5504e02de70 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.504s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:55 user nova-compute[75233]: INFO nova.compute.manager [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Took 15.89 seconds to build instance.
Dec 05 13:38:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c27c12e5-c6e3-40aa-9d42-fe58d88d7b22 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.150s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:38:56 user nova-compute[75233]: INFO nova.compute.claims [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Claim successful on node user
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:38:57 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.policy [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdef50a1eea44e9bbac2fdb4b32a8776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068310b985b44818bb545496e9c20239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:38:57 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Creating image(s)
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.046s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.218s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.221s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk 1073741824" returned: 0 in 0.069s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.221s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Cannot resize image /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Ensure instance console log exists: /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:38:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:00 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Successfully created port: ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Successfully updated port: ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing instance network info cache due to event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance network_info: |[{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Start _get_guest_xml network_info=[{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-618450068',display_name='tempest-ServerStableDeviceRescueTest-server-618450068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-618450068',id=3,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCyvHhzGmozq6uruCNlWPIfLj6uVQK8EP7eWv5aXgCSUtxhFvniepOEQrmaNb6W5GNVSyeRLN51P6XksSXhXlMNxIL4hzl4fOrJYtVmGzfArN0YnViqm0PItIXPSLIeFA==',key_name='tempest-keypair-777986006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068310b985b44818bb545496e9c20239',ramdisk_id='',reservation_id='r-a01ctks7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-507168574',owner_user_name='tempest-ServerStableDeviceRescueTest-507168574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef50a1eea44e9bbac2fdb4b32a8776',uuid=193e4239-ac4b-42d6-a87b-cb3aff3ed71a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converting VIF {"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'pci_devices' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:06 user nova-compute[75233]:   <uuid>193e4239-ac4b-42d6-a87b-cb3aff3ed71a</uuid>
Dec 05 13:39:06 user nova-compute[75233]:   <name>instance-00000003</name>
Dec 05 13:39:06 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:06 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:06 user nova-compute[75233]:   <metadata>
Dec 05 13:39:06 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:06 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:06 user nova-compute[75233]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-618450068</nova:name>
Dec 05 13:39:06 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:06</nova:creationTime>
Dec 05 13:39:06 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:06 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:06 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:06 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:user uuid="cdef50a1eea44e9bbac2fdb4b32a8776">tempest-ServerStableDeviceRescueTest-507168574-project-member</nova:user>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:project uuid="068310b985b44818bb545496e9c20239">tempest-ServerStableDeviceRescueTest-507168574</nova:project>
Dec 05 13:39:06 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:06 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:39:06 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:06 user nova-compute[75233]:         <nova:port uuid="ae30a80c-81bb-4488-87f3-0f7b25393f6d">
Dec 05 13:39:06 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 13:39:06 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:06 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:06 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:06 user nova-compute[75233]:   </metadata>
Dec 05 13:39:06 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:06 user nova-compute[75233]:     <system>
Dec 05 13:39:06 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:06 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:06 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:06 user nova-compute[75233]:       <entry name="serial">193e4239-ac4b-42d6-a87b-cb3aff3ed71a</entry>
Dec 05 13:39:06 user nova-compute[75233]:       <entry name="uuid">193e4239-ac4b-42d6-a87b-cb3aff3ed71a</entry>
Dec 05 13:39:06 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:06 user nova-compute[75233]:     </system>
Dec 05 13:39:06 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:06 user nova-compute[75233]:   <os>
Dec 05 13:39:06 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:06 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:06 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:06 user nova-compute[75233]:   </os>
Dec 05 13:39:06 user nova-compute[75233]:   <features>
Dec 05 13:39:06 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:06 user nova-compute[75233]:     <apic/>
Dec 05 13:39:06 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:06 user nova-compute[75233]:   </features>
Dec 05 13:39:06 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:06 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:06 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:06 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:06 user nova-compute[75233]:   </clock>
Dec 05 13:39:06 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:06 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:06 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:06 user nova-compute[75233]:   </cpu>
Dec 05 13:39:06 user nova-compute[75233]:   <devices>
Dec 05 13:39:06 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:06 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:06 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk"/>
Dec 05 13:39:06 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:06 user nova-compute[75233]:     </disk>
Dec 05 13:39:06 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:06 user nova-compute[75233]:       <mac address="fa:16:3e:b2:7c:53"/>
Dec 05 13:39:06 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:06 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:06 user nova-compute[75233]:       <target dev="tapae30a80c-81"/>
Dec 05 13:39:06 user nova-compute[75233]:     </interface>
Dec 05 13:39:06 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:06 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/console.log" append="off"/>
Dec 05 13:39:06 user nova-compute[75233]:     </serial>
Dec 05 13:39:06 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:06 user nova-compute[75233]:     <video>
Dec 05 13:39:06 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:06 user nova-compute[75233]:     </video>
Dec 05 13:39:06 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:06 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:06 user nova-compute[75233]:     </rng>
Dec 05 13:39:06 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:06 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:06 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:06 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:06 user nova-compute[75233]:   </devices>
Dec 05 13:39:06 user nova-compute[75233]: </domain>
Dec 05 13:39:06 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-618450068',display_name='tempest-ServerStableDeviceRescueTest-server-618450068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-618450068',id=3,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCyvHhzGmozq6uruCNlWPIfLj6uVQK8EP7eWv5aXgCSUtxhFvniepOEQrmaNb6W5GNVSyeRLN51P6XksSXhXlMNxIL4hzl4fOrJYtVmGzfArN0YnViqm0PItIXPSLIeFA==',key_name='tempest-keypair-777986006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='068310b985b44818bb545496e9c20239',ramdisk_id='',reservation_id='r-a01ctks7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-507168574',owner_user_name='tempest-ServerStableDeviceRescueTest-507168574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef50a1eea44e9bbac2fdb4b32a8776',uuid=193e4239-ac4b-42d6-a87b-cb3aff3ed71a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converting VIF {"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG os_vif [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80eb931b-f672-55eb-80c3-e9a8080c4658', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae30a80c-81, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae30a80c-81, col_values=(('qos', UUID('240b9ca7-2a85-4a72-8b77-c86bdb482a52')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae30a80c-81, col_values=(('external_ids', {'iface-id': 'ae30a80c-81bb-4488-87f3-0f7b25393f6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:7c:53', 'vm-uuid': '193e4239-ac4b-42d6-a87b-cb3aff3ed71a'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:06 user nova-compute[75233]: INFO os_vif [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81')
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No VIF found with MAC fa:16:3e:b2:7c:53, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-8168e27a-be61-488b-9a98-692c8e721d38 req-03d03ce3-f155-4391-aa33-a0bc66aa62a1 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8168e27a-be61-488b-9a98-692c8e721d38 req-03d03ce3-f155-4391-aa33-a0bc66aa62a1 service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8168e27a-be61-488b-9a98-692c8e721d38 req-03d03ce3-f155-4391-aa33-a0bc66aa62a1 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8168e27a-be61-488b-9a98-692c8e721d38 req-03d03ce3-f155-4391-aa33-a0bc66aa62a1 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-8168e27a-be61-488b-9a98-692c8e721d38 req-03d03ce3-f155-4391-aa33-a0bc66aa62a1 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:08 user nova-compute[75233]: WARNING nova.compute.manager [req-8168e27a-be61-488b-9a98-692c8e721d38 req-03d03ce3-f155-4391-aa33-a0bc66aa62a1 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state active and task_state None.
Dec 05 13:39:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updated VIF entry in instance network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f25b003-3383-4250-b9d6-49ee14639c88 req-76486319-b78b-4d33-9f54-6d38dd03edae service nova] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:10 user nova-compute[75233]: INFO nova.compute.claims [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Claim successful on node user
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-fe1db4a3-8c14-4406-b07f-c51fbf3ab69f req-4d98121b-a9b6-4730-89b4-60e83c127cd3 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fe1db4a3-8c14-4406-b07f-c51fbf3ab69f req-4d98121b-a9b6-4730-89b4-60e83c127cd3 service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fe1db4a3-8c14-4406-b07f-c51fbf3ab69f req-4d98121b-a9b6-4730-89b4-60e83c127cd3 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fe1db4a3-8c14-4406-b07f-c51fbf3ab69f req-4d98121b-a9b6-4730-89b4-60e83c127cd3 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-fe1db4a3-8c14-4406-b07f-c51fbf3ab69f req-4d98121b-a9b6-4730-89b4-60e83c127cd3 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:10 user nova-compute[75233]: WARNING nova.compute.manager [req-fe1db4a3-8c14-4406-b07f-c51fbf3ab69f req-4d98121b-a9b6-4730-89b4-60e83c127cd3 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state active and task_state None.
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.794s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Creating image(s)
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "/opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "/opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "/opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.policy [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e28e6b2894c844ae864b0283b8824371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426a7cafbfd54c23a56c584b9107d871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance spawned successfully.
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.232s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:11 user nova-compute[75233]: INFO nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Took 14.49 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:12 user nova-compute[75233]: INFO nova.compute.manager [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Took 15.40 seconds to build instance.
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.242s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7b855b7a-87d0-4ad6-9e2b-4300aa35ebbf tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.576s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk 1073741824" returned: 0 in 0.068s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Cannot resize image /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Ensure instance console log exists: /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Successfully created port: b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Successfully updated port: b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquired lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-changed-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Refreshing instance network info cache due to event network-changed-b0eee427-11d4-4575-aeee-33db56579d43. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] Acquiring lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-c221ed49-4aa9-404d-87a7-b47e7a8321bd req-697b5483-c7f6-45a7-9d77-b70ab961ddad service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c221ed49-4aa9-404d-87a7-b47e7a8321bd req-697b5483-c7f6-45a7-9d77-b70ab961ddad service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c221ed49-4aa9-404d-87a7-b47e7a8321bd req-697b5483-c7f6-45a7-9d77-b70ab961ddad service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c221ed49-4aa9-404d-87a7-b47e7a8321bd req-697b5483-c7f6-45a7-9d77-b70ab961ddad service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-c221ed49-4aa9-404d-87a7-b47e7a8321bd req-697b5483-c7f6-45a7-9d77-b70ab961ddad service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:14 user nova-compute[75233]: WARNING nova.compute.manager [req-c221ed49-4aa9-404d-87a7-b47e7a8321bd req-697b5483-c7f6-45a7-9d77-b70ab961ddad service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state active and task_state None.
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updating instance_info_cache with network_info: [{"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Releasing lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Instance network_info: |[{"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] Acquired lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Refreshing network info cache for port b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Start _get_guest_xml network_info=[{"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:15 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:15 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-258621968',display_name='tempest-VolumesAdminNegativeTest-server-258621968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-258621968',id=4,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcprkdI0uORrugH/DtKDi7XQ5hNZUCvjMZpn0qOJSClJPaY04Ujn3Q1mTgX+RkpyVjwFy2LWtuCrD8eRWTWjfAYAyaOQ2XsUiB3g5+k2Xd4fXPZ9CESmUN4MQEul6ArdQ==',key_name='tempest-keypair-376334586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426a7cafbfd54c23a56c584b9107d871',ramdisk_id='',reservation_id='r-1s41pkxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2110311291',owner_user_name='tempest-VolumesAdminNegativeTest-2110311291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28e6b2894c844ae864b0283b8824371',uuid=63978594-a36a-47f8-a596-4e6c1b965e7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converting VIF {"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'pci_devices' on Instance uuid 63978594-a36a-47f8-a596-4e6c1b965e7c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:15 user nova-compute[75233]:   <uuid>63978594-a36a-47f8-a596-4e6c1b965e7c</uuid>
Dec 05 13:39:15 user nova-compute[75233]:   <name>instance-00000004</name>
Dec 05 13:39:15 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:15 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:15 user nova-compute[75233]:   <metadata>
Dec 05 13:39:15 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:15 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:15 user nova-compute[75233]:       <nova:name>tempest-VolumesAdminNegativeTest-server-258621968</nova:name>
Dec 05 13:39:15 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:15</nova:creationTime>
Dec 05 13:39:15 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:15 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:15 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:15 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:user uuid="e28e6b2894c844ae864b0283b8824371">tempest-VolumesAdminNegativeTest-2110311291-project-member</nova:user>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:project uuid="426a7cafbfd54c23a56c584b9107d871">tempest-VolumesAdminNegativeTest-2110311291</nova:project>
Dec 05 13:39:15 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:15 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:39:15 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:15 user nova-compute[75233]:         <nova:port uuid="b0eee427-11d4-4575-aeee-33db56579d43">
Dec 05 13:39:15 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 13:39:15 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:15 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:15 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:15 user nova-compute[75233]:   </metadata>
Dec 05 13:39:15 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:15 user nova-compute[75233]:     <system>
Dec 05 13:39:15 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:15 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:15 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:15 user nova-compute[75233]:       <entry name="serial">63978594-a36a-47f8-a596-4e6c1b965e7c</entry>
Dec 05 13:39:15 user nova-compute[75233]:       <entry name="uuid">63978594-a36a-47f8-a596-4e6c1b965e7c</entry>
Dec 05 13:39:15 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:15 user nova-compute[75233]:     </system>
Dec 05 13:39:15 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:15 user nova-compute[75233]:   <os>
Dec 05 13:39:15 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:15 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:15 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:15 user nova-compute[75233]:   </os>
Dec 05 13:39:15 user nova-compute[75233]:   <features>
Dec 05 13:39:15 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:15 user nova-compute[75233]:     <apic/>
Dec 05 13:39:15 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:15 user nova-compute[75233]:   </features>
Dec 05 13:39:15 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:15 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:15 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:15 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:15 user nova-compute[75233]:   </clock>
Dec 05 13:39:15 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:15 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:15 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:15 user nova-compute[75233]:   </cpu>
Dec 05 13:39:15 user nova-compute[75233]:   <devices>
Dec 05 13:39:15 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:15 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:15 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk"/>
Dec 05 13:39:15 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:15 user nova-compute[75233]:     </disk>
Dec 05 13:39:15 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:15 user nova-compute[75233]:       <mac address="fa:16:3e:03:59:cd"/>
Dec 05 13:39:15 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:15 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:15 user nova-compute[75233]:       <target dev="tapb0eee427-11"/>
Dec 05 13:39:15 user nova-compute[75233]:     </interface>
Dec 05 13:39:15 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:15 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/console.log" append="off"/>
Dec 05 13:39:15 user nova-compute[75233]:     </serial>
Dec 05 13:39:15 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:15 user nova-compute[75233]:     <video>
Dec 05 13:39:15 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:15 user nova-compute[75233]:     </video>
Dec 05 13:39:15 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:15 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:15 user nova-compute[75233]:     </rng>
Dec 05 13:39:15 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:15 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:15 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:15 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:15 user nova-compute[75233]:   </devices>
Dec 05 13:39:15 user nova-compute[75233]: </domain>
Dec 05 13:39:15 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-258621968',display_name='tempest-VolumesAdminNegativeTest-server-258621968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-258621968',id=4,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcprkdI0uORrugH/DtKDi7XQ5hNZUCvjMZpn0qOJSClJPaY04Ujn3Q1mTgX+RkpyVjwFy2LWtuCrD8eRWTWjfAYAyaOQ2XsUiB3g5+k2Xd4fXPZ9CESmUN4MQEul6ArdQ==',key_name='tempest-keypair-376334586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426a7cafbfd54c23a56c584b9107d871',ramdisk_id='',reservation_id='r-1s41pkxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2110311291',owner_user_name='tempest-VolumesAdminNegativeTest-2110311291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28e6b2894c844ae864b0283b8824371',uuid=63978594-a36a-47f8-a596-4e6c1b965e7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converting VIF {"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG os_vif [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da55d9ea-76d3-5076-b55d-560f7ee2e435', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0eee427-11, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0eee427-11, col_values=(('qos', UUID('782b7dfa-64df-4270-96a9-221d7ffb0866')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0eee427-11, col_values=(('external_ids', {'iface-id': 'b0eee427-11d4-4575-aeee-33db56579d43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:59:cd', 'vm-uuid': '63978594-a36a-47f8-a596-4e6c1b965e7c'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:15 user nova-compute[75233]: INFO os_vif [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11')
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No VIF found with MAC fa:16:3e:03:59:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updated VIF entry in instance network info cache for port b0eee427-11d4-4575-aeee-33db56579d43. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updating instance_info_cache with network_info: [{"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7229d77c-5ed8-470b-9510-6bd6e495d1f7 req-50295982-1695-4864-beee-5822113274cc service nova] Releasing lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-877721aa-e771-4ffb-859f-63f08d84bedd req-1cf80ba3-e0b7-42d0-acdf-f8b9a8c4ccfa service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-877721aa-e771-4ffb-859f-63f08d84bedd req-1cf80ba3-e0b7-42d0-acdf-f8b9a8c4ccfa service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-877721aa-e771-4ffb-859f-63f08d84bedd req-1cf80ba3-e0b7-42d0-acdf-f8b9a8c4ccfa service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-877721aa-e771-4ffb-859f-63f08d84bedd req-1cf80ba3-e0b7-42d0-acdf-f8b9a8c4ccfa service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-877721aa-e771-4ffb-859f-63f08d84bedd req-1cf80ba3-e0b7-42d0-acdf-f8b9a8c4ccfa service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:16 user nova-compute[75233]: WARNING nova.compute.manager [req-877721aa-e771-4ffb-859f-63f08d84bedd req-1cf80ba3-e0b7-42d0-acdf-f8b9a8c4ccfa service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state active and task_state None.
Dec 05 13:39:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:17 user nova-compute[75233]: INFO nova.compute.claims [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Claim successful on node user
Dec 05 13:39:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG nova.policy [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '138af9aac17d443aa6218e1b37a53565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e0af9097af457f93beec368ac68066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Creating image(s)
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "/opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "/opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "/opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.249s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.265s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk 1073741824" returned: 0 in 0.070s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:18 user nova-compute[75233]: INFO nova.compute.claims [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Claim successful on node user
Dec 05 13:39:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.225s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Cannot resize image /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Ensure instance console log exists: /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.policy [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56f7dddea94e4a2da0fcc5b103391fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8d4abdb8b54f36bc6add14efac05d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Creating image(s)
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "/opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "/opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "/opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "a960499cf7e87fb52f26ff3b6a57da40130b907f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "a960499cf7e87fb52f26ff3b6a57da40130b907f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Successfully created port: 643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Instance spawned successfully.
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.part --force-share --output=json" returned: 0 in 0.258s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.virt.images [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] 1509f1f1-2653-46b6-9f44-feaae0e809c9 was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.part /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Successfully created port: fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:20 user nova-compute[75233]: INFO nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Took 9.05 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.part /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.converted" returned: 0 in 0.257s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:21 user nova-compute[75233]: INFO nova.compute.manager [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Took 10.89 seconds to build instance.
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6f3cf0a6-0f47-45a6-b425-8c85be09637c tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.068s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f.converted --force-share --output=json" returned: 0 in 0.306s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "a960499cf7e87fb52f26ff3b6a57da40130b907f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.404s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f --force-share --output=json" returned: 0 in 0.222s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "a960499cf7e87fb52f26ff3b6a57da40130b907f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "a960499cf7e87fb52f26ff3b6a57da40130b907f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f --force-share --output=json" returned: 0 in 0.289s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f,backing_fmt=raw /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f,backing_fmt=raw /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk 1073741824" returned: 0 in 0.092s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "a960499cf7e87fb52f26ff3b6a57da40130b907f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.012s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:22 user nova-compute[75233]: INFO nova.compute.claims [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Claim successful on node user
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f --force-share --output=json" returned: 0 in 0.301s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Successfully updated port: fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Successfully updated port: 643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-changed-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Refreshing instance network info cache due to event network-changed-fd294db6-58bd-49b8-85bf-560b9253421c. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] Acquiring lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] Acquired lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Refreshing network info cache for port fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquired lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-changed-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Refreshing instance network info cache due to event network-changed-643f12d8-3bd8-4a62-9bc4-260af906a6e3. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] Acquiring lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Cannot resize image /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Ensure instance console log exists: /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-73535ceb-dc37-4412-9248-96c8f3f2cf6b req-44180031-64b9-47d2-bb9f-dcab7fde2461 service nova] Releasing lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquired lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updating instance_info_cache with network_info: [{"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Releasing lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Instance network_info: |[{"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] Acquired lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Refreshing network info cache for port 643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Start _get_guest_xml network_info=[{"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-585286314',display_name='tempest-TestVolumeSwap-server-585286314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-585286314',id=5,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7XR8qJ9Y7EY4Hta1nxa8++9tWwzT1mqOMwGg+/zU1zu2LURTrW+ohZE/deKS1aKww9rD1kqL3V52Slc0WJLcrbrlFsm0IiZVKj0i+wugsGZTvNAD5vESGy1cfBGU1VpQ==',key_name='tempest-keypair-1486432949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45e0af9097af457f93beec368ac68066',ramdisk_id='',reservation_id='r-58n4g8hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1953399439',owner_user_name='tempest-TestVolumeSwap-1953399439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138af9aac17d443aa6218e1b37a53565',uuid=61b72e12-781d-472c-841d-59cacd38578f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Converting VIF {"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lazy-loading 'pci_devices' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.policy [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b7c7ad4b6e3420eb9b1458993a83420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f74e2293c74d82b37d4bdd6c9db8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:23 user nova-compute[75233]:   <uuid>61b72e12-781d-472c-841d-59cacd38578f</uuid>
Dec 05 13:39:23 user nova-compute[75233]:   <name>instance-00000005</name>
Dec 05 13:39:23 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:23 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:23 user nova-compute[75233]:   <metadata>
Dec 05 13:39:23 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:23 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:name>tempest-TestVolumeSwap-server-585286314</nova:name>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:22</nova:creationTime>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:23 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:23 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:user uuid="138af9aac17d443aa6218e1b37a53565">tempest-TestVolumeSwap-1953399439-project-member</nova:user>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:project uuid="45e0af9097af457f93beec368ac68066">tempest-TestVolumeSwap-1953399439</nova:project>
Dec 05 13:39:23 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:port uuid="643f12d8-3bd8-4a62-9bc4-260af906a6e3">
Dec 05 13:39:23 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 13:39:23 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:23 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:23 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:23 user nova-compute[75233]:   </metadata>
Dec 05 13:39:23 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:23 user nova-compute[75233]:     <system>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="serial">61b72e12-781d-472c-841d-59cacd38578f</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="uuid">61b72e12-781d-472c-841d-59cacd38578f</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:23 user nova-compute[75233]:     </system>
Dec 05 13:39:23 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:23 user nova-compute[75233]:   <os>
Dec 05 13:39:23 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:23 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:23 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:23 user nova-compute[75233]:   </os>
Dec 05 13:39:23 user nova-compute[75233]:   <features>
Dec 05 13:39:23 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:23 user nova-compute[75233]:     <apic/>
Dec 05 13:39:23 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:23 user nova-compute[75233]:   </features>
Dec 05 13:39:23 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:23 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:23 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:23 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:23 user nova-compute[75233]:   </clock>
Dec 05 13:39:23 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:23 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:23 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:23 user nova-compute[75233]:   </cpu>
Dec 05 13:39:23 user nova-compute[75233]:   <devices>
Dec 05 13:39:23 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:23 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:23 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk"/>
Dec 05 13:39:23 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:23 user nova-compute[75233]:     </disk>
Dec 05 13:39:23 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:23 user nova-compute[75233]:       <mac address="fa:16:3e:33:1d:60"/>
Dec 05 13:39:23 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:23 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:23 user nova-compute[75233]:       <target dev="tap643f12d8-3b"/>
Dec 05 13:39:23 user nova-compute[75233]:     </interface>
Dec 05 13:39:23 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:23 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/console.log" append="off"/>
Dec 05 13:39:23 user nova-compute[75233]:     </serial>
Dec 05 13:39:23 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:23 user nova-compute[75233]:     <video>
Dec 05 13:39:23 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:23 user nova-compute[75233]:     </video>
Dec 05 13:39:23 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:23 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:23 user nova-compute[75233]:     </rng>
Dec 05 13:39:23 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:23 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:23 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:23 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:23 user nova-compute[75233]:   </devices>
Dec 05 13:39:23 user nova-compute[75233]: </domain>
Dec 05 13:39:23 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-585286314',display_name='tempest-TestVolumeSwap-server-585286314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-585286314',id=5,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7XR8qJ9Y7EY4Hta1nxa8++9tWwzT1mqOMwGg+/zU1zu2LURTrW+ohZE/deKS1aKww9rD1kqL3V52Slc0WJLcrbrlFsm0IiZVKj0i+wugsGZTvNAD5vESGy1cfBGU1VpQ==',key_name='tempest-keypair-1486432949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45e0af9097af457f93beec368ac68066',ramdisk_id='',reservation_id='r-58n4g8hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1953399439',owner_user_name='tempest-TestVolumeSwap-1953399439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138af9aac17d443aa6218e1b37a53565',uuid=61b72e12-781d-472c-841d-59cacd38578f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Converting VIF {"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG os_vif [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dc7ebb1-84d2-5f53-a681-a27c326dc6f8', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap643f12d8-3b, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap643f12d8-3b, col_values=(('qos', UUID('fe661b61-dcd5-4287-98fa-05a8a3a9b2fe')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap643f12d8-3b, col_values=(('external_ids', {'iface-id': '643f12d8-3bd8-4a62-9bc4-260af906a6e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:1d:60', 'vm-uuid': '61b72e12-781d-472c-841d-59cacd38578f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: INFO os_vif [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b')
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Creating image(s)
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] No VIF found with MAC fa:16:3e:33:1d:60, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.238s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Updating instance_info_cache with network_info: [{"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Releasing lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Instance network_info: |[{"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Start _get_guest_xml network_info=[{"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:39:07Z,direct_url=<?>,disk_format='qcow2',id=1509f1f1-2653-46b6-9f44-feaae0e809c9,min_disk=0,min_ram=0,name='',owner='87ae9fcd51ff4f3a98d4d3198be49de8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:39:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'encryption_format': None, 'image_id': '1509f1f1-2653-46b6-9f44-feaae0e809c9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:23 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:23 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:39:07Z,direct_url=<?>,disk_format='qcow2',id=1509f1f1-2653-46b6-9f44-feaae0e809c9,min_disk=0,min_ram=0,name='',owner='87ae9fcd51ff4f3a98d4d3198be49de8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:39:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1445738985',display_name='tempest-AttachSCSIVolumeTestJSON-server-1445738985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1445738985',id=6,image_ref='1509f1f1-2653-46b6-9f44-feaae0e809c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrZrshm0tmXP/xbjDIEwk86wnXlVY9iAIFz+wUBTWznM9XdkMMs3aOt4C5HibeiG16IwP/sYnoLJnNieb4olMl6OfklrDrLDSURFS9NUKWEcDS2CXWT3j6/wfCpEUyiWw==',key_name='tempest-keypair-1163673000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8d4abdb8b54f36bc6add14efac05d3',ramdisk_id='',reservation_id='r-tyk0sr5x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1509f1f1-2653-46b6-9f44-feaae0e809c9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1030047827',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1030047827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56f7dddea94e4a2da0fcc5b103391fcd',uuid=e82c73ba-0a1a-42e2-8d47-9e4721fe57b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Converting VIF {"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lazy-loading 'pci_devices' on Instance uuid e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.246s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:23 user nova-compute[75233]:   <uuid>e82c73ba-0a1a-42e2-8d47-9e4721fe57b5</uuid>
Dec 05 13:39:23 user nova-compute[75233]:   <name>instance-00000006</name>
Dec 05 13:39:23 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:23 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:23 user nova-compute[75233]:   <metadata>
Dec 05 13:39:23 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:23 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1445738985</nova:name>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:23</nova:creationTime>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:23 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:23 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:user uuid="56f7dddea94e4a2da0fcc5b103391fcd">tempest-AttachSCSIVolumeTestJSON-1030047827-project-member</nova:user>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:project uuid="3d8d4abdb8b54f36bc6add14efac05d3">tempest-AttachSCSIVolumeTestJSON-1030047827</nova:project>
Dec 05 13:39:23 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:root type="image" uuid="1509f1f1-2653-46b6-9f44-feaae0e809c9"/>
Dec 05 13:39:23 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:23 user nova-compute[75233]:         <nova:port uuid="fd294db6-58bd-49b8-85bf-560b9253421c">
Dec 05 13:39:23 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 13:39:23 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:23 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:23 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:23 user nova-compute[75233]:   </metadata>
Dec 05 13:39:23 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:23 user nova-compute[75233]:     <system>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="serial">e82c73ba-0a1a-42e2-8d47-9e4721fe57b5</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="uuid">e82c73ba-0a1a-42e2-8d47-9e4721fe57b5</entry>
Dec 05 13:39:23 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:23 user nova-compute[75233]:     </system>
Dec 05 13:39:23 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:23 user nova-compute[75233]:   <os>
Dec 05 13:39:23 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:23 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:23 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:23 user nova-compute[75233]:   </os>
Dec 05 13:39:23 user nova-compute[75233]:   <features>
Dec 05 13:39:23 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:23 user nova-compute[75233]:     <apic/>
Dec 05 13:39:23 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:23 user nova-compute[75233]:   </features>
Dec 05 13:39:23 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:23 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:23 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:23 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:23 user nova-compute[75233]:   </clock>
Dec 05 13:39:23 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:23 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:23 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:23 user nova-compute[75233]:   </cpu>
Dec 05 13:39:23 user nova-compute[75233]:   <devices>
Dec 05 13:39:23 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:23 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:23 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk"/>
Dec 05 13:39:23 user nova-compute[75233]:       <target dev="sda" bus="scsi"/>
Dec 05 13:39:23 user nova-compute[75233]:       <address type="drive" controller="0" unit="0"/>
Dec 05 13:39:23 user nova-compute[75233]:     </disk>
Dec 05 13:39:23 user nova-compute[75233]:     <disk type="file" device="cdrom">
Dec 05 13:39:23 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 13:39:23 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.config"/>
Dec 05 13:39:23 user nova-compute[75233]:       <target dev="sdb" bus="scsi"/>
Dec 05 13:39:23 user nova-compute[75233]:       <address type="drive" controller="0" unit="1"/>
Dec 05 13:39:23 user nova-compute[75233]:     </disk>
Dec 05 13:39:23 user nova-compute[75233]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 05 13:39:23 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:23 user nova-compute[75233]:       <mac address="fa:16:3e:15:00:5d"/>
Dec 05 13:39:23 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:23 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:23 user nova-compute[75233]:       <target dev="tapfd294db6-58"/>
Dec 05 13:39:23 user nova-compute[75233]:     </interface>
Dec 05 13:39:23 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:23 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/console.log" append="off"/>
Dec 05 13:39:23 user nova-compute[75233]:     </serial>
Dec 05 13:39:23 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:23 user nova-compute[75233]:     <video>
Dec 05 13:39:23 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:23 user nova-compute[75233]:     </video>
Dec 05 13:39:23 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:23 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:23 user nova-compute[75233]:     </rng>
Dec 05 13:39:23 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:23 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:23 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:23 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:23 user nova-compute[75233]:   </devices>
Dec 05 13:39:23 user nova-compute[75233]: </domain>
Dec 05 13:39:23 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1445738985',display_name='tempest-AttachSCSIVolumeTestJSON-server-1445738985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1445738985',id=6,image_ref='1509f1f1-2653-46b6-9f44-feaae0e809c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrZrshm0tmXP/xbjDIEwk86wnXlVY9iAIFz+wUBTWznM9XdkMMs3aOt4C5HibeiG16IwP/sYnoLJnNieb4olMl6OfklrDrLDSURFS9NUKWEcDS2CXWT3j6/wfCpEUyiWw==',key_name='tempest-keypair-1163673000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8d4abdb8b54f36bc6add14efac05d3',ramdisk_id='',reservation_id='r-tyk0sr5x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1509f1f1-2653-46b6-9f44-feaae0e809c9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1030047827',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1030047827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56f7dddea94e4a2da0fcc5b103391fcd',uuid=e82c73ba-0a1a-42e2-8d47-9e4721fe57b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Converting VIF {"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG os_vif [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk 1073741824" returned: 0 in 0.122s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ab7a320-1a4a-5d84-a53f-d1a568c3efcd', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd294db6-58, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd294db6-58, col_values=(('qos', UUID('7e7fde71-04b9-4b37-a019-c27529e27da8')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd294db6-58, col_values=(('external_ids', {'iface-id': 'fd294db6-58bd-49b8-85bf-560b9253421c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:00:5d', 'vm-uuid': 'e82c73ba-0a1a-42e2-8d47-9e4721fe57b5'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:23 user nova-compute[75233]: INFO os_vif [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58')
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.234s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No BDM found with device name sda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No VIF found with MAC fa:16:3e:15:00:5d, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:24 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Using config drive
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.network.neutron [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updated VIF entry in instance network info cache for port 643f12d8-3bd8-4a62-9bc4-260af906a6e3. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.network.neutron [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updating instance_info_cache with network_info: [{"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-365c1c3d-97c7-4a2e-92af-614414b59910 req-837b2b03-226d-43bf-91ed-d9f7e6e2bc39 service nova] Releasing lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Cannot resize image /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Ensure instance console log exists: /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Successfully created port: 1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:24 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Creating config drive at /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.config
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1xoundey {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1xoundey" returned: 0 in 0.066s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Successfully updated port: 1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquired lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-changed-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Refreshing instance network info cache due to event network-changed-1ad882c8-81f9-48ed-a978-734805dd9564. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] Acquiring lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Releasing lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Instance network_info: |[{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] Acquired lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Refreshing network info cache for port 1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Start _get_guest_xml network_info=[{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.objects.instance [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'pci_devices' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:25 user nova-compute[75233]:   <uuid>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</uuid>
Dec 05 13:39:25 user nova-compute[75233]:   <name>instance-00000007</name>
Dec 05 13:39:25 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:25 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:25 user nova-compute[75233]:   <metadata>
Dec 05 13:39:25 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:25 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:25 user nova-compute[75233]:       <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:39:25 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:25</nova:creationTime>
Dec 05 13:39:25 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:25 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:25 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:25 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:39:25 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:25 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:39:25 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:25 user nova-compute[75233]:         <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:39:25 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:39:25 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:25 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:25 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:25 user nova-compute[75233]:   </metadata>
Dec 05 13:39:25 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:25 user nova-compute[75233]:     <system>
Dec 05 13:39:25 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:25 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:25 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:25 user nova-compute[75233]:       <entry name="serial">cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:39:25 user nova-compute[75233]:       <entry name="uuid">cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:39:25 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:25 user nova-compute[75233]:     </system>
Dec 05 13:39:25 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:25 user nova-compute[75233]:   <os>
Dec 05 13:39:25 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:25 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:25 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:25 user nova-compute[75233]:   </os>
Dec 05 13:39:25 user nova-compute[75233]:   <features>
Dec 05 13:39:25 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:25 user nova-compute[75233]:     <apic/>
Dec 05 13:39:25 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:25 user nova-compute[75233]:   </features>
Dec 05 13:39:25 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:25 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:25 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:25 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:25 user nova-compute[75233]:   </clock>
Dec 05 13:39:25 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:25 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:25 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:25 user nova-compute[75233]:   </cpu>
Dec 05 13:39:25 user nova-compute[75233]:   <devices>
Dec 05 13:39:25 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:25 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:25 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk"/>
Dec 05 13:39:25 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:25 user nova-compute[75233]:     </disk>
Dec 05 13:39:25 user nova-compute[75233]:     <disk type="file" device="cdrom">
Dec 05 13:39:25 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 13:39:25 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config"/>
Dec 05 13:39:25 user nova-compute[75233]:       <target dev="hda" bus="ide"/>
Dec 05 13:39:25 user nova-compute[75233]:     </disk>
Dec 05 13:39:25 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:25 user nova-compute[75233]:       <mac address="fa:16:3e:73:8c:03"/>
Dec 05 13:39:25 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:25 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:25 user nova-compute[75233]:       <target dev="tap1ad882c8-81"/>
Dec 05 13:39:25 user nova-compute[75233]:     </interface>
Dec 05 13:39:25 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:25 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log" append="off"/>
Dec 05 13:39:25 user nova-compute[75233]:     </serial>
Dec 05 13:39:25 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:25 user nova-compute[75233]:     <video>
Dec 05 13:39:25 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:25 user nova-compute[75233]:     </video>
Dec 05 13:39:25 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:25 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:25 user nova-compute[75233]:     </rng>
Dec 05 13:39:25 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:25 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:25 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:25 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:25 user nova-compute[75233]:   </devices>
Dec 05 13:39:25 user nova-compute[75233]: </domain>
Dec 05 13:39:25 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG os_vif [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95acd23d-b472-515a-af58-3f92c070d226', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad882c8-81, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ad882c8-81, col_values=(('qos', UUID('c9511efd-fa11-4e84-99ab-fa0f328f7f59')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ad882c8-81, col_values=(('external_ids', {'iface-id': '1ad882c8-81f9-48ed-a978-734805dd9564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:8c:03', 'vm-uuid': 'cf62dc1b-8a7e-48ac-88e7-420ce6b9851c'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:25 user nova-compute[75233]: INFO os_vif [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81')
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No BDM found with device name hda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No VIF found with MAC fa:16:3e:73:8c:03, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Using config drive
Dec 05 13:39:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updated VIF entry in instance network info cache for port 1ad882c8-81f9-48ed-a978-734805dd9564. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f8debc41-c23e-463f-b8b1-97613523dd24 req-3f200711-8cb1-4be9-8f8e-32d9d1833868 service nova] Releasing lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Creating config drive at /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config
Dec 05 13:39:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9d6zxsl4 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9d6zxsl4" returned: 0 in 0.065s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:27 user nova-compute[75233]: INFO nova.compute.claims [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Claim successful on node user
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:28 user nova-compute[75233]: DEBUG nova.policy [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '416a535a8f2c47d38ddb6a62f00b1874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ef1cc1000f47e38c59a4e503709890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:29 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Creating image(s)
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "/opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "/opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "/opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.274s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.294s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk 1073741824" returned: 0 in 0.072s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.256s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:39:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Successfully created port: 184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Cannot resize image /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Ensure instance console log exists: /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.compute.claims [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Claim successful on node user
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Instance spawned successfully.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Instance spawned successfully.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Successfully updated port: 184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Took 13.21 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquired lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-5c55b88e-978c-4efc-a844-2a9c36923349 req-22968e8c-3e87-4442-a6f6-dc5606e2f1d2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5c55b88e-978c-4efc-a844-2a9c36923349 req-22968e8c-3e87-4442-a6f6-dc5606e2f1d2 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5c55b88e-978c-4efc-a844-2a9c36923349 req-22968e8c-3e87-4442-a6f6-dc5606e2f1d2 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5c55b88e-978c-4efc-a844-2a9c36923349 req-22968e8c-3e87-4442-a6f6-dc5606e2f1d2 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-5c55b88e-978c-4efc-a844-2a9c36923349 req-22968e8c-3e87-4442-a6f6-dc5606e2f1d2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:31 user nova-compute[75233]: WARNING nova.compute.manager [req-5c55b88e-978c-4efc-a844-2a9c36923349 req-22968e8c-3e87-4442-a6f6-dc5606e2f1d2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state None.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-changed-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Refreshing instance network info cache due to event network-changed-184f8015-da2f-409e-832c-09c3c81a1e7e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] Acquiring lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Took 11.75 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Instance spawned successfully.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.compute.manager [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Took 12.96 seconds to build instance.
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.compute.manager [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Took 14.93 seconds to build instance.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ef19109a-44be-450d-8e14-0c2988c639f4 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.249s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d3a0b62d-f814-4c2a-8dcc-173f01fcc825 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.485s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.865s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:31 user nova-compute[75233]: INFO nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Took 8.77 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:32 user nova-compute[75233]: INFO nova.compute.manager [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Took 10.11 seconds to build instance.
Dec 05 13:39:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-64b612dd-99d1-44e3-ae16-1c9f7b88b571 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.530s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updating instance_info_cache with network_info: [{"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.policy [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '158e2993042b45339f98fc5fff0aaf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4d0d8d26d14eebac1d61089119a062', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Releasing lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Instance network_info: |[{"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] Acquired lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.neutron [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Refreshing network info cache for port 184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Start _get_guest_xml network_info=[{"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:32 user nova-compute[75233]: INFO nova.virt.block_device [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Booting with volume 6621e3db-b8d2-4e8b-b76c-e7af765972e1 at /dev/vda
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1228387339',display_name='tempest-VolumesAssistedSnapshotsTest-server-1228387339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1228387339',id=8,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2PEedseFCDjuv3FXKWwYDgAIc0J1Oy+sUPNsGDUZEJvCTtJ8OXZV87uprPQpK8lWRpmIrfHPAucCWQbQWvOyLU3SQ8rmN/9T4Tb9OEY5q8ius+DQ5kFcWPl92C10TITQ==',key_name='tempest-keypair-2147439686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ef1cc1000f47e38c59a4e503709890',ramdisk_id='',reservation_id='r-q0zgni02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1865583520',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1865583520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='416a535a8f2c47d38ddb6a62f00b1874',uuid=82f774ff-049f-4504-9fd0-b526079a13d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Converting VIF {"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lazy-loading 'pci_devices' on Instance uuid 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:32 user nova-compute[75233]:   <uuid>82f774ff-049f-4504-9fd0-b526079a13d5</uuid>
Dec 05 13:39:32 user nova-compute[75233]:   <name>instance-00000008</name>
Dec 05 13:39:32 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:32 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:32 user nova-compute[75233]:   <metadata>
Dec 05 13:39:32 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:32 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:32 user nova-compute[75233]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1228387339</nova:name>
Dec 05 13:39:32 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:32</nova:creationTime>
Dec 05 13:39:32 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:32 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:32 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:32 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:user uuid="416a535a8f2c47d38ddb6a62f00b1874">tempest-VolumesAssistedSnapshotsTest-1865583520-project-member</nova:user>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:project uuid="73ef1cc1000f47e38c59a4e503709890">tempest-VolumesAssistedSnapshotsTest-1865583520</nova:project>
Dec 05 13:39:32 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:32 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:39:32 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:32 user nova-compute[75233]:         <nova:port uuid="184f8015-da2f-409e-832c-09c3c81a1e7e">
Dec 05 13:39:32 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 13:39:32 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:32 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:32 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:32 user nova-compute[75233]:   </metadata>
Dec 05 13:39:32 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:32 user nova-compute[75233]:     <system>
Dec 05 13:39:32 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:32 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:32 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:32 user nova-compute[75233]:       <entry name="serial">82f774ff-049f-4504-9fd0-b526079a13d5</entry>
Dec 05 13:39:32 user nova-compute[75233]:       <entry name="uuid">82f774ff-049f-4504-9fd0-b526079a13d5</entry>
Dec 05 13:39:32 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:32 user nova-compute[75233]:     </system>
Dec 05 13:39:32 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:32 user nova-compute[75233]:   <os>
Dec 05 13:39:32 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:32 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:32 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:32 user nova-compute[75233]:   </os>
Dec 05 13:39:32 user nova-compute[75233]:   <features>
Dec 05 13:39:32 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:32 user nova-compute[75233]:     <apic/>
Dec 05 13:39:32 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:32 user nova-compute[75233]:   </features>
Dec 05 13:39:32 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:32 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:32 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:32 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:32 user nova-compute[75233]:   </clock>
Dec 05 13:39:32 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:32 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:32 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:32 user nova-compute[75233]:   </cpu>
Dec 05 13:39:32 user nova-compute[75233]:   <devices>
Dec 05 13:39:32 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:32 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:32 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk"/>
Dec 05 13:39:32 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:32 user nova-compute[75233]:     </disk>
Dec 05 13:39:32 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:32 user nova-compute[75233]:       <mac address="fa:16:3e:9f:ae:88"/>
Dec 05 13:39:32 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:32 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:32 user nova-compute[75233]:       <target dev="tap184f8015-da"/>
Dec 05 13:39:32 user nova-compute[75233]:     </interface>
Dec 05 13:39:32 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:32 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/console.log" append="off"/>
Dec 05 13:39:32 user nova-compute[75233]:     </serial>
Dec 05 13:39:32 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:32 user nova-compute[75233]:     <video>
Dec 05 13:39:32 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:32 user nova-compute[75233]:     </video>
Dec 05 13:39:32 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:32 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:32 user nova-compute[75233]:     </rng>
Dec 05 13:39:32 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:32 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:32 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:32 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:32 user nova-compute[75233]:   </devices>
Dec 05 13:39:32 user nova-compute[75233]: </domain>
Dec 05 13:39:32 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1228387339',display_name='tempest-VolumesAssistedSnapshotsTest-server-1228387339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1228387339',id=8,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2PEedseFCDjuv3FXKWwYDgAIc0J1Oy+sUPNsGDUZEJvCTtJ8OXZV87uprPQpK8lWRpmIrfHPAucCWQbQWvOyLU3SQ8rmN/9T4Tb9OEY5q8ius+DQ5kFcWPl92C10TITQ==',key_name='tempest-keypair-2147439686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ef1cc1000f47e38c59a4e503709890',ramdisk_id='',reservation_id='r-q0zgni02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1865583520',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1865583520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='416a535a8f2c47d38ddb6a62f00b1874',uuid=82f774ff-049f-4504-9fd0-b526079a13d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Converting VIF {"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG os_vif [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1944c353-9713-5f21-a454-52557ce71ff2', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap184f8015-da, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap184f8015-da, col_values=(('qos', UUID('0c1380cf-34e6-4f4e-8c4c-c41b7e560a40')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap184f8015-da, col_values=(('external_ids', {'iface-id': '184f8015-da2f-409e-832c-09c3c81a1e7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:ae:88', 'vm-uuid': '82f774ff-049f-4504-9fd0-b526079a13d5'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:32 user nova-compute[75233]: INFO os_vif [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da')
Dec 05 13:39:32 user nova-compute[75233]: DEBUG os_brick.utils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:39:32 user nova-compute[75233]: INFO oslo.privsep.daemon [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1_gczqqo/privsep.sock']
Dec 05 13:39:32 user sudo[86188]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1_gczqqo/privsep.sock
Dec 05 13:39:32 user sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] No VIF found with MAC fa:16:3e:9f:ae:88, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.network.neutron [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updated VIF entry in instance network info cache for port 184f8015-da2f-409e-832c-09c3c81a1e7e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.network.neutron [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updating instance_info_cache with network_info: [{"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5fdc3934-f7f2-4937-8f3f-2bda6b1f3e8e req-307430d5-e747-4df7-9371-0320971920bd service nova] Releasing lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Successfully created port: 2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:33 user nova-compute[75233]: WARNING nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state None.
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] No waiting events found dispatching network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:33 user nova-compute[75233]: WARNING nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received unexpected event network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 for instance with vm_state active and task_state None.
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] No waiting events found dispatching network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:33 user nova-compute[75233]: WARNING nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received unexpected event network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 for instance with vm_state active and task_state None.
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] No waiting events found dispatching network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:33 user nova-compute[75233]: WARNING nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received unexpected event network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 for instance with vm_state active and task_state None.
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] No waiting events found dispatching network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:33 user nova-compute[75233]: WARNING nova.compute.manager [req-ca8ea348-afde-4bba-96b9-53c61e8376bf req-969f78be-7429-4bc5-b9ad-ea93b25f4fbd service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received unexpected event network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 for instance with vm_state active and task_state None.
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Successfully updated port: 2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquired lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.compute.manager [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-changed-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.compute.manager [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Refreshing instance network info cache due to event network-changed-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] Acquiring lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:34 user sudo[86188]: pam_unix(sudo:session): session closed for user root
Dec 05 13:39:34 user nova-compute[75233]: INFO oslo.privsep.daemon [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Spawned new privsep daemon via rootwrap
Dec 05 13:39:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:34 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 13:39:34 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 13:39:34 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 05 13:39:34 user nova-compute[75233]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86205
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0632e349-09b8-42be-bc01-0c39ae59917b]: (2,) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67b5ede-27ec-4981-9517-fc345a51c4a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:35 user nova-compute[75233]: WARNING os_brick.initiator.connectors.nvmeof [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5cbc9-2a1c-491b-bacc-9c41bd699cc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[420a8aa0-e2ae-49f6-9b0f-e5773bfe5531]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90f771-a59a-4a10-9433-b7af9d471c8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:39:35 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ea9c8f-b57f-4d35-8633-bd72de4e0cdb]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG os_brick.utils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== get_connector_properties: return (2945ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updating existing volume attachment record: ba4f3e6f-253e-43a6-960d-4323e55f4a21 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updating instance_info_cache with network_info: [{"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Releasing lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance network_info: |[{"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] Acquired lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.network.neutron [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Refreshing network info cache for port 2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] No waiting events found dispatching network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:35 user nova-compute[75233]: WARNING nova.compute.manager [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received unexpected event network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e for instance with vm_state building and task_state spawning.
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] No waiting events found dispatching network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:35 user nova-compute[75233]: WARNING nova.compute.manager [req-bb29818b-352e-4853-8bb7-03cfdabcff95 req-e2a03b5f-124a-4a08-b686-b0c69435336e service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received unexpected event network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e for instance with vm_state building and task_state spawning.
Dec 05 13:39:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updated VIF entry in instance network info cache for port 2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:39:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updating instance_info_cache with network_info: [{"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6d152231-b7ce-4da3-8183-7da0176780ff req-0c9604a2-6ad3-4ba7-b541-2f88d5bd38fb service nova] Releasing lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:37 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Instance spawned successfully.
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:38 user nova-compute[75233]: INFO nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Took 9.14 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:38 user nova-compute[75233]: INFO nova.compute.manager [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Took 10.38 seconds to build instance.
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf076e60-bf32-4522-a644-277c79f8498c tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.520s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:39:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:39 user nova-compute[75233]: INFO nova.compute.claims [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Claim successful on node user
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-a359267b-afd4-4b7d-aea0-368f51d55b9c req-74f6043b-9511-4c7a-a851-da8438e94fe6 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a359267b-afd4-4b7d-aea0-368f51d55b9c req-74f6043b-9511-4c7a-a851-da8438e94fe6 service nova] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a359267b-afd4-4b7d-aea0-368f51d55b9c req-74f6043b-9511-4c7a-a851-da8438e94fe6 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a359267b-afd4-4b7d-aea0-368f51d55b9c req-74f6043b-9511-4c7a-a851-da8438e94fe6 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-a359267b-afd4-4b7d-aea0-368f51d55b9c req-74f6043b-9511-4c7a-a851-da8438e94fe6 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] No waiting events found dispatching network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:40 user nova-compute[75233]: WARNING nova.compute.manager [req-a359267b-afd4-4b7d-aea0-368f51d55b9c req-74f6043b-9511-4c7a-a851-da8438e94fe6 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received unexpected event network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c for instance with vm_state active and task_state None.
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.network.neutron [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG nova.policy [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e64aa1ef9e44d52a0587c6b009a1e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc0f5f6a8ad42c989c5900f97815384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Creating image(s)
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "/opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "/opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "/opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.218s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.224s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk 1073741824" returned: 0 in 0.074s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Successfully created port: a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.259s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Cannot resize image /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Ensure instance console log exists: /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Successfully updated port: a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-changed-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Refreshing instance network info cache due to event network-changed-a07ae192-8145-45ac-be9f-a7242a978e5d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] Acquiring lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] Acquired lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Refreshing network info cache for port a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:39:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] No waiting events found dispatching network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:43 user nova-compute[75233]: WARNING nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received unexpected event network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c for instance with vm_state active and task_state None.
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:43 user nova-compute[75233]: WARNING nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 for instance with vm_state active and task_state None.
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:43 user nova-compute[75233]: WARNING nova.compute.manager [req-47aa50f4-fdff-4848-8711-1b83838f7f3f req-abbf7f88-8d5b-41ee-a701-8390d7508700 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 for instance with vm_state active and task_state None.
Dec 05 13:39:43 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:43 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:43 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7999MB free_disk=25.470417022705078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.neutron [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77aa5e15-7169-4497-a68e-96dc209719a4 req-d8da12ff-389f-4ac0-8ce0-9973ae68eb5e service nova] Releasing lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquired lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 63978594-a36a-47f8-a596-4e6c1b965e7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 61b72e12-781d-472c-841d-59cacd38578f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 82f774ff-049f-4504-9fd0-b526079a13d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 885d9ddc-a084-472d-9422-5c93f549090d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Updating instance_info_cache with network_info: [{"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Releasing lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Instance network_info: |[{"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Start _get_guest_xml network_info=[{"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:44 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:44 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2130072599',display_name='tempest-VolumesSnapshotTestJSON-instance-2130072599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2130072599',id=10,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrLXBiHjvHEaDghe78gdzYzSIVR1z3OrJVmAcpE1CZQEq9eYkr+OHicb6PvRCxUassmWbJpfnH5gzx56EpefNJF44ZOYPiCH563O/UDjYGpT7vvX9Dn1ZQ1XRyD6yMI3w==',key_name='tempest-keypair-852631441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc0f5f6a8ad42c989c5900f97815384',ramdisk_id='',reservation_id='r-i4njd3x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1540026955',owner_user_name='tempest-VolumesSnapshotTestJSON-1540026955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e64aa1ef9e44d52a0587c6b009a1e9a',uuid=885d9ddc-a084-472d-9422-5c93f549090d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converting VIF {"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'pci_devices' on Instance uuid 885d9ddc-a084-472d-9422-5c93f549090d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:44 user nova-compute[75233]:   <uuid>885d9ddc-a084-472d-9422-5c93f549090d</uuid>
Dec 05 13:39:44 user nova-compute[75233]:   <name>instance-0000000a</name>
Dec 05 13:39:44 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:44 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:44 user nova-compute[75233]:   <metadata>
Dec 05 13:39:44 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:44 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:44 user nova-compute[75233]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2130072599</nova:name>
Dec 05 13:39:44 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:44</nova:creationTime>
Dec 05 13:39:44 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:44 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:44 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:44 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:user uuid="7e64aa1ef9e44d52a0587c6b009a1e9a">tempest-VolumesSnapshotTestJSON-1540026955-project-member</nova:user>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:project uuid="dcc0f5f6a8ad42c989c5900f97815384">tempest-VolumesSnapshotTestJSON-1540026955</nova:project>
Dec 05 13:39:44 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:44 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:39:44 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:44 user nova-compute[75233]:         <nova:port uuid="a07ae192-8145-45ac-be9f-a7242a978e5d">
Dec 05 13:39:44 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 13:39:44 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:44 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:44 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:44 user nova-compute[75233]:   </metadata>
Dec 05 13:39:44 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:44 user nova-compute[75233]:     <system>
Dec 05 13:39:44 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:44 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:44 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:44 user nova-compute[75233]:       <entry name="serial">885d9ddc-a084-472d-9422-5c93f549090d</entry>
Dec 05 13:39:44 user nova-compute[75233]:       <entry name="uuid">885d9ddc-a084-472d-9422-5c93f549090d</entry>
Dec 05 13:39:44 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:44 user nova-compute[75233]:     </system>
Dec 05 13:39:44 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:44 user nova-compute[75233]:   <os>
Dec 05 13:39:44 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:44 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:44 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:44 user nova-compute[75233]:   </os>
Dec 05 13:39:44 user nova-compute[75233]:   <features>
Dec 05 13:39:44 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:44 user nova-compute[75233]:     <apic/>
Dec 05 13:39:44 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:44 user nova-compute[75233]:   </features>
Dec 05 13:39:44 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:44 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:44 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:44 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:44 user nova-compute[75233]:   </clock>
Dec 05 13:39:44 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:44 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:44 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:44 user nova-compute[75233]:   </cpu>
Dec 05 13:39:44 user nova-compute[75233]:   <devices>
Dec 05 13:39:44 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:39:44 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:39:44 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk"/>
Dec 05 13:39:44 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:44 user nova-compute[75233]:     </disk>
Dec 05 13:39:44 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:44 user nova-compute[75233]:       <mac address="fa:16:3e:79:77:80"/>
Dec 05 13:39:44 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:44 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:44 user nova-compute[75233]:       <target dev="tapa07ae192-81"/>
Dec 05 13:39:44 user nova-compute[75233]:     </interface>
Dec 05 13:39:44 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:44 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/console.log" append="off"/>
Dec 05 13:39:44 user nova-compute[75233]:     </serial>
Dec 05 13:39:44 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:44 user nova-compute[75233]:     <video>
Dec 05 13:39:44 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:44 user nova-compute[75233]:     </video>
Dec 05 13:39:44 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:44 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:44 user nova-compute[75233]:     </rng>
Dec 05 13:39:44 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:44 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:44 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:44 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:44 user nova-compute[75233]:   </devices>
Dec 05 13:39:44 user nova-compute[75233]: </domain>
Dec 05 13:39:44 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2130072599',display_name='tempest-VolumesSnapshotTestJSON-instance-2130072599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2130072599',id=10,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrLXBiHjvHEaDghe78gdzYzSIVR1z3OrJVmAcpE1CZQEq9eYkr+OHicb6PvRCxUassmWbJpfnH5gzx56EpefNJF44ZOYPiCH563O/UDjYGpT7vvX9Dn1ZQ1XRyD6yMI3w==',key_name='tempest-keypair-852631441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc0f5f6a8ad42c989c5900f97815384',ramdisk_id='',reservation_id='r-i4njd3x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1540026955',owner_user_name='tempest-VolumesSnapshotTestJSON-1540026955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e64aa1ef9e44d52a0587c6b009a1e9a',uuid=885d9ddc-a084-472d-9422-5c93f549090d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converting VIF {"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG os_vif [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bc89eb8-dcb1-56e1-8a6d-5f63bd5b4e9c', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa07ae192-81, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa07ae192-81, col_values=(('qos', UUID('fc2f7eee-4ede-4709-ad55-96497539bf33')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa07ae192-81, col_values=(('external_ids', {'iface-id': 'a07ae192-8145-45ac-be9f-a7242a978e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:77:80', 'vm-uuid': '885d9ddc-a084-472d-9422-5c93f549090d'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:45 user nova-compute[75233]: INFO os_vif [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81')
Dec 05 13:39:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No VIF found with MAC fa:16:3e:79:77:80, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:39:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.732s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-f98f8bc1-17ca-40aa-a6bb-7afcd6d39cc5 req-7d747e77-3a7e-47f4-b453-9fda2d85e883 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f98f8bc1-17ca-40aa-a6bb-7afcd6d39cc5 req-7d747e77-3a7e-47f4-b453-9fda2d85e883 service nova] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f98f8bc1-17ca-40aa-a6bb-7afcd6d39cc5 req-7d747e77-3a7e-47f4-b453-9fda2d85e883 service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f98f8bc1-17ca-40aa-a6bb-7afcd6d39cc5 req-7d747e77-3a7e-47f4-b453-9fda2d85e883 service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-f98f8bc1-17ca-40aa-a6bb-7afcd6d39cc5 req-7d747e77-3a7e-47f4-b453-9fda2d85e883 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] No waiting events found dispatching network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:47 user nova-compute[75233]: WARNING nova.compute.manager [req-f98f8bc1-17ca-40aa-a6bb-7afcd6d39cc5 req-7d747e77-3a7e-47f4-b453-9fda2d85e883 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received unexpected event network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d for instance with vm_state building and task_state spawning.
Dec 05 13:39:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Skipping network cache update for instance because it is Building. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Skipping network cache update for instance because it is Building. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:39:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Creating image(s)
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Start _get_guest_xml network_info=[{"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5', 'attached_at': '', 'detached_at': '', 'volume_id': '6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'serial': '6621e3db-b8d2-4e8b-b76c-e7af765972e1'}, 'delete_on_termination': True, 'attachment_id': 'ba4f3e6f-253e-43a6-960d-4323e55f4a21', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:39:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connector [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Factory for ISCSI on None {{(pid=75233) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:39:48 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:39:48 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:39:48 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224a074-c49a-477a-b9aa-82ed6d9a02ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:39:48 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd279ce1-3e6a-40ec-a126-96d8ea7dff37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1] added
Dec 05 13:39:48 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22955f52-30f2-431c-8ddb-506603fb427d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d8f70-f6f6-42c2-9e25-df71b8e9741d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToLYGdhj {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToLYGdhj" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[363311da-59f2-41ef-b548-8bee4a2b5ef6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ToLYGdhj'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15bd5c8-fddb-446f-8622-2b5be8f62e33]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e590bad2-be0b-4039-bef3-c3ecd7884ffd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 13:39:49 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 13:39:49 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:39:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 13:39:49 user nova-compute[75233]: 
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a9094c-1be3-4c99-b6bd-0ae3bd13b402]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]
Dec 05 13:39:49 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.
Dec 05 13:39:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d2fd6d-6271-4caf-a46b-1de4e5708438]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d14d9ca-32d9-44c2-8bb7-4e82160321d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:39:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:39:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f9c692-f5b7-40d9-8873-f451a5d7f2ce]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-c2372db9-5a3e-4e04-8f6a-b5664ccbfeea req-5d139148-9601-46de-b18f-d999ff688632 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c2372db9-5a3e-4e04-8f6a-b5664ccbfeea req-5d139148-9601-46de-b18f-d999ff688632 service nova] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c2372db9-5a3e-4e04-8f6a-b5664ccbfeea req-5d139148-9601-46de-b18f-d999ff688632 service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c2372db9-5a3e-4e04-8f6a-b5664ccbfeea req-5d139148-9601-46de-b18f-d999ff688632 service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-c2372db9-5a3e-4e04-8f6a-b5664ccbfeea req-5d139148-9601-46de-b18f-d999ff688632 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] No waiting events found dispatching network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:49 user nova-compute[75233]: WARNING nova.compute.manager [req-c2372db9-5a3e-4e04-8f6a-b5664ccbfeea req-5d139148-9601-46de-b18f-d999ff688632 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received unexpected event network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d for instance with vm_state building and task_state spawning.
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:49 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Instance spawned successfully.
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:49 user nova-compute[75233]: INFO nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Took 8.53 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:49 user nova-compute[75233]: INFO nova.compute.manager [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Took 10.07 seconds to build instance.
Dec 05 13:39:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-92d2647f-1d74-4dd9-9d58-b921983f311b tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.221s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23135316337663434', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135316337663434', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-198484875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-198484875',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBjirTdgwguXf8pJpDGH38q17eBDHncaQ+iB6D3hlb+s4hJpshKYtlQvlsbwGbpt6MhXarCfCtSdWaWLFu4ehJfgNc1TbGggoGeDFMM241T3aOm8pSjB5QSszJrkc/AA==',key_name='tempest-keypair-791952996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e4d0d8d26d14eebac1d61089119a062',ramdisk_id='',reservation_id='r-5tvy1x7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1073184207',owner_user_name='tempest-ServerActionsV293TestJSON-1073184207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158e2993042b45339f98fc5fff0aaf2c',uuid=0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converting VIF {"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:39:50 user nova-compute[75233]:   <uuid>0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5</uuid>
Dec 05 13:39:50 user nova-compute[75233]:   <name>instance-00000009</name>
Dec 05 13:39:50 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:39:50 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:39:50 user nova-compute[75233]:   <metadata>
Dec 05 13:39:50 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:39:50 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:39:50 user nova-compute[75233]:       <nova:name>tempest-ServerActionsV293TestJSON-server-198484875</nova:name>
Dec 05 13:39:50 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:39:48</nova:creationTime>
Dec 05 13:39:50 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:39:50 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:39:50 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:39:50 user nova-compute[75233]:       <nova:owner>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:user uuid="158e2993042b45339f98fc5fff0aaf2c">tempest-ServerActionsV293TestJSON-1073184207-project-member</nova:user>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:project uuid="8e4d0d8d26d14eebac1d61089119a062">tempest-ServerActionsV293TestJSON-1073184207</nova:project>
Dec 05 13:39:50 user nova-compute[75233]:       </nova:owner>
Dec 05 13:39:50 user nova-compute[75233]:       <nova:ports>
Dec 05 13:39:50 user nova-compute[75233]:         <nova:port uuid="2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c">
Dec 05 13:39:50 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 13:39:50 user nova-compute[75233]:         </nova:port>
Dec 05 13:39:50 user nova-compute[75233]:       </nova:ports>
Dec 05 13:39:50 user nova-compute[75233]:     </nova:instance>
Dec 05 13:39:50 user nova-compute[75233]:   </metadata>
Dec 05 13:39:50 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:39:50 user nova-compute[75233]:     <system>
Dec 05 13:39:50 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:39:50 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:39:50 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:39:50 user nova-compute[75233]:       <entry name="serial">0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5</entry>
Dec 05 13:39:50 user nova-compute[75233]:       <entry name="uuid">0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5</entry>
Dec 05 13:39:50 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:39:50 user nova-compute[75233]:     </system>
Dec 05 13:39:50 user nova-compute[75233]:   </sysinfo>
Dec 05 13:39:50 user nova-compute[75233]:   <os>
Dec 05 13:39:50 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:39:50 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:39:50 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:39:50 user nova-compute[75233]:   </os>
Dec 05 13:39:50 user nova-compute[75233]:   <features>
Dec 05 13:39:50 user nova-compute[75233]:     <acpi/>
Dec 05 13:39:50 user nova-compute[75233]:     <apic/>
Dec 05 13:39:50 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:39:50 user nova-compute[75233]:   </features>
Dec 05 13:39:50 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:39:50 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:39:50 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:39:50 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:39:50 user nova-compute[75233]:   </clock>
Dec 05 13:39:50 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:39:50 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:39:50 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:39:50 user nova-compute[75233]:   </cpu>
Dec 05 13:39:50 user nova-compute[75233]:   <devices>
Dec 05 13:39:50 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:39:50 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:39:50 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 13:39:50 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:39:50 user nova-compute[75233]:       <serial>6621e3db-b8d2-4e8b-b76c-e7af765972e1</serial>
Dec 05 13:39:50 user nova-compute[75233]:     </disk>
Dec 05 13:39:50 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:39:50 user nova-compute[75233]:       <mac address="fa:16:3e:be:ca:d7"/>
Dec 05 13:39:50 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:50 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:39:50 user nova-compute[75233]:       <target dev="tap2a9a4a9a-4a"/>
Dec 05 13:39:50 user nova-compute[75233]:     </interface>
Dec 05 13:39:50 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:39:50 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5/console.log" append="off"/>
Dec 05 13:39:50 user nova-compute[75233]:     </serial>
Dec 05 13:39:50 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:39:50 user nova-compute[75233]:     <video>
Dec 05 13:39:50 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:39:50 user nova-compute[75233]:     </video>
Dec 05 13:39:50 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:39:50 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:39:50 user nova-compute[75233]:     </rng>
Dec 05 13:39:50 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:39:50 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:39:50 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:39:50 user nova-compute[75233]:     </memballoon>
Dec 05 13:39:50 user nova-compute[75233]:   </devices>
Dec 05 13:39:50 user nova-compute[75233]: </domain>
Dec 05 13:39:50 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-198484875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-198484875',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBjirTdgwguXf8pJpDGH38q17eBDHncaQ+iB6D3hlb+s4hJpshKYtlQvlsbwGbpt6MhXarCfCtSdWaWLFu4ehJfgNc1TbGggoGeDFMM241T3aOm8pSjB5QSszJrkc/AA==',key_name='tempest-keypair-791952996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e4d0d8d26d14eebac1d61089119a062',ramdisk_id='',reservation_id='r-5tvy1x7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1073184207',owner_user_name='tempest-ServerActionsV293TestJSON-1073184207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158e2993042b45339f98fc5fff0aaf2c',uuid=0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converting VIF {"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG os_vif [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a701dee-3482-50ba-ba65-9fb9deb33f47', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a9a4a9a-4a, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a9a4a9a-4a, col_values=(('qos', UUID('f307db62-da2f-473a-b029-681b820061a6')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a9a4a9a-4a, col_values=(('external_ids', {'iface-id': '2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ca:d7', 'vm-uuid': '0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:50 user nova-compute[75233]: INFO os_vif [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a')
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:39:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] No VIF found with MAC fa:16:3e:be:ca:d7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:39:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-9d212961-b25e-4dee-b8bd-a3e7ae7ccb77 req-9930b6f5-189d-46c2-89d0-3a84641542e1 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d212961-b25e-4dee-b8bd-a3e7ae7ccb77 req-9930b6f5-189d-46c2-89d0-3a84641542e1 service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d212961-b25e-4dee-b8bd-a3e7ae7ccb77 req-9930b6f5-189d-46c2-89d0-3a84641542e1 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d212961-b25e-4dee-b8bd-a3e7ae7ccb77 req-9930b6f5-189d-46c2-89d0-3a84641542e1 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-9d212961-b25e-4dee-b8bd-a3e7ae7ccb77 req-9930b6f5-189d-46c2-89d0-3a84641542e1 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:52 user nova-compute[75233]: WARNING nova.compute.manager [req-9d212961-b25e-4dee-b8bd-a3e7ae7ccb77 req-9930b6f5-189d-46c2-89d0-3a84641542e1 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state building and task_state spawning.
Dec 05 13:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-90d8beb4-d1c5-49cd-a1d1-a007b7575a77 req-6d790a56-23ff-40e3-bc14-9ce9fb7d5e4a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-90d8beb4-d1c5-49cd-a1d1-a007b7575a77 req-6d790a56-23ff-40e3-bc14-9ce9fb7d5e4a service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-90d8beb4-d1c5-49cd-a1d1-a007b7575a77 req-6d790a56-23ff-40e3-bc14-9ce9fb7d5e4a service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-90d8beb4-d1c5-49cd-a1d1-a007b7575a77 req-6d790a56-23ff-40e3-bc14-9ce9fb7d5e4a service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-90d8beb4-d1c5-49cd-a1d1-a007b7575a77 req-6d790a56-23ff-40e3-bc14-9ce9fb7d5e4a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:39:54 user nova-compute[75233]: WARNING nova.compute.manager [req-90d8beb4-d1c5-49cd-a1d1-a007b7575a77 req-6d790a56-23ff-40e3-bc14-9ce9fb7d5e4a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state building and task_state spawning.
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:39:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance spawned successfully.
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:39:54 user nova-compute[75233]: INFO nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Took 5.70 seconds to spawn the instance on the hypervisor.
Dec 05 13:39:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:39:54 user nova-compute[75233]: INFO nova.compute.manager [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Took 23.63 seconds to build instance.
Dec 05 13:39:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e60c380d-9775-48b1-8910-caa1be9624a0 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.852s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:58 user nova-compute[75233]: INFO nova.compute.claims [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Claim successful on node user
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.633s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:39:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:39:58 user nova-compute[75233]: INFO nova.compute.claims [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Claim successful on node user
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:59 user nova-compute[75233]: INFO nova.virt.block_device [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Booting with volume a5399c35-f7eb-4e16-96c6-47a0f3329769 at /dev/vda
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.policy [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3f1614c6f8b49c48d6fc69b2133c600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b9175eaa564bc08df6a8f358865fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.utils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c64db1-3394-4185-bc76-3b34be38e46d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2439f2-975c-45ff-acec-bd3e1b731552]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f2c49c-7dcb-48a3-8824-5403ab78c6bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370956a-b0ed-46d5-b1be-803d8dbd5c93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:39:59 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777170f-3f40-4bef-b071-d9c13981ba08]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.utils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating existing volume attachment record: a16ed371-5f3c-48fe-9626-0a9324020a94 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:39:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:39:59 user nova-compute[75233]: INFO nova.virt.block_device [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Booting with volume d958bdc4-575a-487d-9ce9-ba02c3e403cf at /dev/vda
Dec 05 13:39:59 user nova-compute[75233]: DEBUG nova.policy [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b2069f5a667407ea5b92c2f605af2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ab2194e480431abd2d2e27aa394177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG os_brick.utils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa37ef-90af-4744-80be-f3ddc46b5f65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:39:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f4a20-71c6-4ec5-9354-a1a0f0b5b850]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a2451f-e462-4a91-ace6-9b1146643a38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c76f0-7a56-4246-bc31-fae840a76456]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully created port: 903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:00 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:40:00 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f914c67-24ef-4ea4-9bdd-0b154e9b5378]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG os_brick.utils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating existing volume attachment record: a2caa202-db00-4e9a-a596-071ccc183b26 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully created port: d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:00 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully created port: 37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:01 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully created port: 483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:01 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully created port: 41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully created port: 7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully created port: 08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully created port: fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully created port: 5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: 903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-903392ae-faa6-42cc-aaaa-480aaf6f50e7. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG nova.network.neutron [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port 903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG nova.network.neutron [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully created port: 97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:04 user nova-compute[75233]: DEBUG nova.network.neutron [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5146ca3c-80c1-4668-ab7f-66ac277cefa7 req-868bc2ea-35f1-49aa-a5d0-e8e0f29d0127 service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: 37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-37916b1b-6c4a-458c-bb6e-c83241a127cc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: 61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:40:05 user nova-compute[75233]: INFO nova.compute.claims [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Claim successful on node user
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-ac01118f-15bc-4182-af5f-73349fb26b3f. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a8df2f45-c2be-49bf-9a89-ff58b95ef234 req-b0e24512-21e2-49df-8401-d858f5c8cf5e service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-61f4b0a9-95e0-4752-97ba-47f8f5359e15. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port 61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:40:06 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: 3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:40:06 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Creating image(s)
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "/opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "/opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "/opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.policy [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '010444fd3eb7443183b91242dea6162f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37cdc2a01234cfcb96bf24cb8c0681c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-693dbeee-fd99-4c3d-b3f5-518139d80fab req-d239ae06-435b-4a9e-a8d5-3d395d18a98c service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.252s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk 1073741824" returned: 0 in 0.075s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: 483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Successfully created port: 04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Cannot resize image /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Ensure instance console log exists: /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-3f0aba05-78aa-4a57-8dcb-078fce6c7784. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-d3dc4614-6e00-4a6a-9db8-d436f984d9a7. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Successfully updated port: 04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "refresh_cache-293626c1-0760-43ab-8a9b-ebf0a659fb8b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquired lock "refresh_cache-293626c1-0760-43ab-8a9b-ebf0a659fb8b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-changed-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Refreshing instance network info cache due to event network-changed-04447cb6-67cc-447d-8966-59ef344b42da. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] Acquiring lock "refresh_cache-293626c1-0760-43ab-8a9b-ebf0a659fb8b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7be29b54-f9be-4712-918f-3577ff06e7ef req-613f363b-0eed-4f2d-9cc7-f03eb6b1be91 service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-483a3a1b-0fdb-4a8f-97ca-16628a74672d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port 483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: 41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: 7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Updating instance_info_cache with network_info: [{"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Releasing lock "refresh_cache-293626c1-0760-43ab-8a9b-ebf0a659fb8b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Instance network_info: |[{"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] Acquired lock "refresh_cache-293626c1-0760-43ab-8a9b-ebf0a659fb8b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Refreshing network info cache for port 04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Start _get_guest_xml network_info=[{"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:40:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-268008852',display_name='tempest-VolumesNegativeTest-instance-268008852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-268008852',id=13,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e37cdc2a01234cfcb96bf24cb8c0681c',ramdisk_id='',reservation_id='r-4345btzx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2105369082',owner_user_name='tempest-VolumesNegativeTest-2105369082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:07Z,user_data=None,user_id='010444fd3eb7443183b91242dea6162f',uuid=293626c1-0760-43ab-8a9b-ebf0a659fb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Converting VIF {"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lazy-loading 'pci_devices' on Instance uuid 293626c1-0760-43ab-8a9b-ebf0a659fb8b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:40:08 user nova-compute[75233]:   <uuid>293626c1-0760-43ab-8a9b-ebf0a659fb8b</uuid>
Dec 05 13:40:08 user nova-compute[75233]:   <name>instance-0000000d</name>
Dec 05 13:40:08 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:40:08 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:40:08 user nova-compute[75233]:   <metadata>
Dec 05 13:40:08 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:40:08 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:40:08 user nova-compute[75233]:       <nova:name>tempest-VolumesNegativeTest-instance-268008852</nova:name>
Dec 05 13:40:08 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:40:08</nova:creationTime>
Dec 05 13:40:08 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:40:08 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:40:08 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:40:08 user nova-compute[75233]:       <nova:owner>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:user uuid="010444fd3eb7443183b91242dea6162f">tempest-VolumesNegativeTest-2105369082-project-member</nova:user>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:project uuid="e37cdc2a01234cfcb96bf24cb8c0681c">tempest-VolumesNegativeTest-2105369082</nova:project>
Dec 05 13:40:08 user nova-compute[75233]:       </nova:owner>
Dec 05 13:40:08 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:40:08 user nova-compute[75233]:       <nova:ports>
Dec 05 13:40:08 user nova-compute[75233]:         <nova:port uuid="04447cb6-67cc-447d-8966-59ef344b42da">
Dec 05 13:40:08 user nova-compute[75233]:           <nova:ip type="fixed" address="192.168.233.178" ipVersion="4"/>
Dec 05 13:40:08 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:08 user nova-compute[75233]:       </nova:ports>
Dec 05 13:40:08 user nova-compute[75233]:     </nova:instance>
Dec 05 13:40:08 user nova-compute[75233]:   </metadata>
Dec 05 13:40:08 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:40:08 user nova-compute[75233]:     <system>
Dec 05 13:40:08 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:40:08 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:40:08 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:40:08 user nova-compute[75233]:       <entry name="serial">293626c1-0760-43ab-8a9b-ebf0a659fb8b</entry>
Dec 05 13:40:08 user nova-compute[75233]:       <entry name="uuid">293626c1-0760-43ab-8a9b-ebf0a659fb8b</entry>
Dec 05 13:40:08 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:40:08 user nova-compute[75233]:     </system>
Dec 05 13:40:08 user nova-compute[75233]:   </sysinfo>
Dec 05 13:40:08 user nova-compute[75233]:   <os>
Dec 05 13:40:08 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:40:08 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:40:08 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:40:08 user nova-compute[75233]:   </os>
Dec 05 13:40:08 user nova-compute[75233]:   <features>
Dec 05 13:40:08 user nova-compute[75233]:     <acpi/>
Dec 05 13:40:08 user nova-compute[75233]:     <apic/>
Dec 05 13:40:08 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:40:08 user nova-compute[75233]:   </features>
Dec 05 13:40:08 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:40:08 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:40:08 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:40:08 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:40:08 user nova-compute[75233]:   </clock>
Dec 05 13:40:08 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:40:08 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:40:08 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:40:08 user nova-compute[75233]:   </cpu>
Dec 05 13:40:08 user nova-compute[75233]:   <devices>
Dec 05 13:40:08 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:40:08 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:40:08 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk"/>
Dec 05 13:40:08 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:40:08 user nova-compute[75233]:     </disk>
Dec 05 13:40:08 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:08 user nova-compute[75233]:       <mac address="fa:16:3e:8c:e1:67"/>
Dec 05 13:40:08 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:08 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:08 user nova-compute[75233]:       <target dev="tap04447cb6-67"/>
Dec 05 13:40:08 user nova-compute[75233]:     </interface>
Dec 05 13:40:08 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:40:08 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/console.log" append="off"/>
Dec 05 13:40:08 user nova-compute[75233]:     </serial>
Dec 05 13:40:08 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:40:08 user nova-compute[75233]:     <video>
Dec 05 13:40:08 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:08 user nova-compute[75233]:     </video>
Dec 05 13:40:08 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:40:08 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:40:08 user nova-compute[75233]:     </rng>
Dec 05 13:40:08 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:40:08 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:40:08 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:40:08 user nova-compute[75233]:     </memballoon>
Dec 05 13:40:08 user nova-compute[75233]:   </devices>
Dec 05 13:40:08 user nova-compute[75233]: </domain>
Dec 05 13:40:08 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-268008852',display_name='tempest-VolumesNegativeTest-instance-268008852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-268008852',id=13,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e37cdc2a01234cfcb96bf24cb8c0681c',ramdisk_id='',reservation_id='r-4345btzx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2105369082',owner_user_name='tempest-VolumesNegativeTest-2105369082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:07Z,user_data=None,user_id='010444fd3eb7443183b91242dea6162f',uuid=293626c1-0760-43ab-8a9b-ebf0a659fb8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Converting VIF {"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG os_vif [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '427b9d3a-0290-5d44-8d41-72fee070cbcf', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04447cb6-67, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04447cb6-67, col_values=(('qos', UUID('44038765-5b87-4d64-a5f3-e5e9e404a5cf')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04447cb6-67, col_values=(('external_ids', {'iface-id': '04447cb6-67cc-447d-8966-59ef344b42da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e1:67', 'vm-uuid': '293626c1-0760-43ab-8a9b-ebf0a659fb8b'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:08 user nova-compute[75233]: INFO os_vif [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67')
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] No VIF found with MAC fa:16:3e:8c:e1:67, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05cb33c3-83fc-45c7-89ef-a2b034e3a8b2 req-18d47bc6-dbc0-4795-8643-a470a05f898f service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Updated VIF entry in instance network info cache for port 04447cb6-67cc-447d-8966-59ef344b42da. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Updating instance_info_cache with network_info: [{"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-de51501c-ea3a-48ea-8e07-912fd0ce928e req-ad4f0cf9-3be7-44a6-a51d-22745354492c service nova] Releasing lock "refresh_cache-293626c1-0760-43ab-8a9b-ebf0a659fb8b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Successfully updated port: fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: 08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-41f728b9-8d5c-4809-b371-67153855343c. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-7061c9ce-8024-4f64-9572-a363bb470f95. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-08d1661e-06b3-4562-80fe-4b8fb15950a9. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: 5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e873721-f9fb-4f6b-b443-34f9a0648966 req-b868357e-d36f-4644-a598-24df27b5548b service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Successfully updated port: 97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:10 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-5fa00b5d-73c6-4493-9cb4-d4ae97598d51. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [{"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance network_info: |[{"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:11 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port 7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] No waiting events found dispatching network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:12 user nova-compute[75233]: WARNING nova.compute.manager [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received unexpected event network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da for instance with vm_state building and task_state spawning.
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] No waiting events found dispatching network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:12 user nova-compute[75233]: WARNING nova.compute.manager [req-f014e5d4-9da1-47d7-aebf-748fc333fcb7 req-8ac30b8f-b980-4aac-98fc-6215c77bb8cc service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received unexpected event network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da for instance with vm_state building and task_state spawning.
Dec 05 13:40:12 user nova-compute[75233]: INFO nova.virt.block_device [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Booting with volume 18495a8b-3eb7-4b11-b971-c6860b5bf854 at /dev/vdb
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.utils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0add41d-818e-4fd9-be66-b2e42943f8fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f281a9-1d57-4224-9d57-4b4c8085f1c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b59d83-5251-4734-a2a9-fdec9c67b72e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[269be7a2-d4f9-4e61-9ae3-d0c862fd997b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:12 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b68a450-3160-400f-a20d-48d7d2c3f854]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.utils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating existing volume attachment record: 229c8ef3-a2cb-4ea2-9fa3-35499bae24f1 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updated VIF entry in instance network info cache for port 7061c9ce-8024-4f64-9572-a363bb470f95. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [{"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-fb1a68ef-58d9-48f4-a82d-6e7756b34818. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:12 user nova-compute[75233]: INFO nova.virt.block_device [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Booting with volume 5f43d22f-52a4-4415-8793-2434aec5d460 at /dev/vdb
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.utils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b99e02-8ce3-4eb6-82a3-78804e9c8559]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5dbaa0-36e6-4c89-ae03-c6bdc5f07069]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[23819232-fe9c-4ab2-b2be-8cec20c9add7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[415c6717-51bc-40b5-ae2d-a914dc16b0dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:12 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0694bd10-fbe1-46ef-9145-19c4e1fdb636]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG os_brick.utils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating existing volume attachment record: eb2ea6d2-bccc-4f86-8d80-743542da6dbf {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:40:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Instance spawned successfully.
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updated VIF entry in instance network info cache for port fb1a68ef-58d9-48f4-a82d-6e7756b34818. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [{"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a58b373-8a02-42c4-8000-a40037754918 req-a30186af-8d64-4f77-9860-92c740980740 service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:12 user nova-compute[75233]: INFO nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Took 6.23 seconds to spawn the instance on the hypervisor.
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:40:12 user nova-compute[75233]: INFO nova.compute.manager [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Took 7.45 seconds to build instance.
Dec 05 13:40:12 user nova-compute[75233]: DEBUG nova.network.neutron [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8180f627-9e9a-4557-bb8a-69d36ee37e9d tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.596s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance network_info: |[{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updated VIF entry in instance network info cache for port 5fa00b5d-73c6-4493-9cb4-d4ae97598d51. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-97faf99e-f277-44f6-8ecb-dabef4c582b4. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updated VIF entry in instance network info cache for port 97faf99e-f277-44f6-8ecb-dabef4c582b4. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0fac97f1-f111-4bc1-9691-ded358f09619 req-fa89c3a4-0a5c-419e-87f9-936bcd343e72 service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:22 user nova-compute[75233]: INFO nova.virt.block_device [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Booting with volume af942720-f286-43e3-aac7-6f8bc76bda33 at /dev/vdc
Dec 05 13:40:22 user nova-compute[75233]: INFO nova.virt.block_device [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Booting with volume bf704330-c22b-4921-9338-0e30467d551a at /dev/vdc
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.utils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1837e2-74e1-4bd6-8ae3-991e5202a972]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.utils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee779957-3b9c-44fa-a399-d89d673ba949]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e773c-8997-4878-becf-b66e19df8143]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[64380710-9470-438a-aa4d-314fbc5c1395]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7155b622-787b-4767-b70d-46476a0a4228]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d5ef9-d231-446a-958b-de4901cc561a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:22 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddea6e6-a9ba-4d60-8b04-7cb51f288b9a]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.utils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating existing volume attachment record: 9e3ad740-c3bf-4332-bc49-daf0c9f242cd {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[233e3ff6-fe4e-4bef-a039-107f440fadb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1cc29-3683-4973-8de8-fa108f435d59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:40:22 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:40:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb6d7f-c6d7-4aef-af01-8a7aeb6a4a7c]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG os_brick.utils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:22 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating existing volume attachment record: 35a3f0cc-4243-4419-a5d4-b707556c856b {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:40:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:31 user nova-compute[75233]: INFO nova.compute.manager [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Rescuing
Dec 05 13:40:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:40:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-68e505f9-74c6-41bf-b57d-57caa8dcc6ae req-5e06ddc6-3fd3-4ed0-a373-832c54f8d28a service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-unplugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-68e505f9-74c6-41bf-b57d-57caa8dcc6ae req-5e06ddc6-3fd3-4ed0-a373-832c54f8d28a service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-68e505f9-74c6-41bf-b57d-57caa8dcc6ae req-5e06ddc6-3fd3-4ed0-a373-832c54f8d28a service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-68e505f9-74c6-41bf-b57d-57caa8dcc6ae req-5e06ddc6-3fd3-4ed0-a373-832c54f8d28a service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-68e505f9-74c6-41bf-b57d-57caa8dcc6ae req-5e06ddc6-3fd3-4ed0-a373-832c54f8d28a service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-unplugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:32 user nova-compute[75233]: WARNING nova.compute.manager [req-68e505f9-74c6-41bf-b57d-57caa8dcc6ae req-5e06ddc6-3fd3-4ed0-a373-832c54f8d28a service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-unplugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state active and task_state rescuing.
Dec 05 13:40:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance destroyed successfully.
Dec 05 13:40:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Attempting rescue
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:40:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Creating image(s)
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.293s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue" returned: 0 in 0.052s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'migration_context' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.base [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<5164ddc7-a09d-46b5-893c-c42aad687a3b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Start _get_guest_xml network_info=[{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:3b:e4:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'resources' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.base [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<5164ddc7-a09d-46b5-893c-c42aad687a3b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'numa_topology' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.base [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<5164ddc7-a09d-46b5-893c-c42aad687a3b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:40:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:40:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<5164ddc7-a09d-46b5-893c-c42aad687a3b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355690095',display_name='tempest-ServerRescueNegativeTestJSON-server-355690095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355690095',id=2,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1lgdd8ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:55Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=5164ddc7-a09d-46b5-893c-c42aad687a3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:3b:e4:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:3b:e4:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'pci_devices' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:40:33 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Creating image(s)
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Start _get_guest_xml network_info=[{"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isNfaOoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5399c35-f7eb-4e16-96c6-47a0f3329769', 'serial': 'a5399c35-f7eb-4e16-96c6-47a0f3329769'}, 'delete_on_termination': False, 'attachment_id': 'a16ed371-5f3c-48fe-9626-0a9324020a94', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtsMQvcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f', 'attached_at': '', 'detached_at': '', 'volume_id': '5f43d22f-52a4-4415-8793-2434aec5d460', 'serial': '5f43d22f-52a4-4415-8793-2434aec5d460'}, 'delete_on_termination': False, 'attachment_id': 'eb2ea6d2-bccc-4f86-8d80-743542da6dbf', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjefnkIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf704330-c22b-4921-9338-0e30467d551a', 'serial': 'bf704330-c22b-4921-9338-0e30467d551a'}, 'delete_on_termination': False, 'attachment_id': '35a3f0cc-4243-4419-a5d4-b707556c856b', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<5164ddc7-a09d-46b5-893c-c42aad687a3b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:40:33 user nova-compute[75233]:   <uuid>5164ddc7-a09d-46b5-893c-c42aad687a3b</uuid>
Dec 05 13:40:33 user nova-compute[75233]:   <name>instance-00000002</name>
Dec 05 13:40:33 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:40:33 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:40:33 user nova-compute[75233]:   <metadata>
Dec 05 13:40:33 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:40:33 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:40:33 user nova-compute[75233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-355690095</nova:name>
Dec 05 13:40:33 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:40:32</nova:creationTime>
Dec 05 13:40:33 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:40:33 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:40:33 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:40:33 user nova-compute[75233]:       <nova:owner>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:user uuid="e7ddf7a828a547e9b606ed9e8e8727eb">tempest-ServerRescueNegativeTestJSON-2142653953-project-member</nova:user>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:project uuid="16b7c3d1e9a7462b8c4833174777873e">tempest-ServerRescueNegativeTestJSON-2142653953</nova:project>
Dec 05 13:40:33 user nova-compute[75233]:       </nova:owner>
Dec 05 13:40:33 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:40:33 user nova-compute[75233]:       <nova:ports>
Dec 05 13:40:33 user nova-compute[75233]:         <nova:port uuid="e97d17ec-d682-4bbe-9c3b-5c12697d1e9f">
Dec 05 13:40:33 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:40:33 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:33 user nova-compute[75233]:       </nova:ports>
Dec 05 13:40:33 user nova-compute[75233]:     </nova:instance>
Dec 05 13:40:33 user nova-compute[75233]:   </metadata>
Dec 05 13:40:33 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:40:33 user nova-compute[75233]:     <system>
Dec 05 13:40:33 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:40:33 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:40:33 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:40:33 user nova-compute[75233]:       <entry name="serial">5164ddc7-a09d-46b5-893c-c42aad687a3b</entry>
Dec 05 13:40:33 user nova-compute[75233]:       <entry name="uuid">5164ddc7-a09d-46b5-893c-c42aad687a3b</entry>
Dec 05 13:40:33 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:40:33 user nova-compute[75233]:     </system>
Dec 05 13:40:33 user nova-compute[75233]:   </sysinfo>
Dec 05 13:40:33 user nova-compute[75233]:   <os>
Dec 05 13:40:33 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:40:33 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:40:33 user nova-compute[75233]:   </os>
Dec 05 13:40:33 user nova-compute[75233]:   <features>
Dec 05 13:40:33 user nova-compute[75233]:     <acpi/>
Dec 05 13:40:33 user nova-compute[75233]:     <apic/>
Dec 05 13:40:33 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:40:33 user nova-compute[75233]:   </features>
Dec 05 13:40:33 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:40:33 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:40:33 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:40:33 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:40:33 user nova-compute[75233]:   </clock>
Dec 05 13:40:33 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:40:33 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:40:33 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:40:33 user nova-compute[75233]:   </cpu>
Dec 05 13:40:33 user nova-compute[75233]:   <devices>
Dec 05 13:40:33 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:40:33 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:40:33 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue"/>
Dec 05 13:40:33 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:40:33 user nova-compute[75233]:     </disk>
Dec 05 13:40:33 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:40:33 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:40:33 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk"/>
Dec 05 13:40:33 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:40:33 user nova-compute[75233]:     </disk>
Dec 05 13:40:33 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:33 user nova-compute[75233]:       <mac address="fa:16:3e:3b:e4:87"/>
Dec 05 13:40:33 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:33 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:33 user nova-compute[75233]:       <target dev="tape97d17ec-d6"/>
Dec 05 13:40:33 user nova-compute[75233]:     </interface>
Dec 05 13:40:33 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:40:33 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/console.log" append="off"/>
Dec 05 13:40:33 user nova-compute[75233]:     </serial>
Dec 05 13:40:33 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:40:33 user nova-compute[75233]:     <video>
Dec 05 13:40:33 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:33 user nova-compute[75233]:     </video>
Dec 05 13:40:33 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:40:33 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:40:33 user nova-compute[75233]:     </rng>
Dec 05 13:40:33 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:40:33 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:40:33 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:40:33 user nova-compute[75233]:     </memballoon>
Dec 05 13:40:33 user nova-compute[75233]:   </devices>
Dec 05 13:40:33 user nova-compute[75233]: </domain>
Dec 05 13:40:33 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:40:33 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:33 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isNfaOoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:33 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:33 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:33 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:40:33 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance destroyed successfully.
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:40:33 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Creating image(s)
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Ensure instance console log exists: /opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Start _get_guest_xml network_info=[{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzjTpDho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edbd6067-bd46-4f66-a10d-a01e36efca03', 'attached_at': '', 'detached_at': '', 'volume_id': 'd958bdc4-575a-487d-9ce9-ba02c3e403cf', 'serial': 'd958bdc4-575a-487d-9ce9-ba02c3e403cf'}, 'delete_on_termination': False, 'attachment_id': 'a2caa202-db00-4e9a-a596-071ccc183b26', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBjLNsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edbd6067-bd46-4f66-a10d-a01e36efca03', 'attached_at': '', 'detached_at': '', 'volume_id': '18495a8b-3eb7-4b11-b971-c6860b5bf854', 'serial': '18495a8b-3eb7-4b11-b971-c6860b5bf854'}, 'delete_on_termination': False, 'attachment_id': '229c8ef3-a2cb-4ea2-9fa3-35499bae24f1', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHDsIfcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edbd6067-bd46-4f66-a10d-a01e36efca03', 'attached_at': '', 'detached_at': '', 'volume_id': 'af942720-f286-43e3-aac7-6f8bc76bda33', 'serial': 'af942720-f286-43e3-aac7-6f8bc76bda33'}, 'delete_on_termination': False, 'attachment_id': '9e3ad740-c3bf-4332-bc49-daf0c9f242cd', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd87873-e5f4-40c9-afb6-5aaeee0384c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:40:33 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:33 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzjTpDho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:33 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd60157-f693-48f8-b9eb-6a045277dd1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769] added
Dec 05 13:40:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:3b:e4:87, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2347829-ca15-4bdf-8359-8ffa25d324f7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5905de7d-ffad-4394-be2f-55de65162a95]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isNfaOoe {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isNfaOoe" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bfe049-6e71-4fde-8462-961003edf266]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'isNfaOoe'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f394e6a-4cbd-459f-9d6e-7d9e6d8ea174]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf4a14-4d67-42b5-9da9-2680d0bfc84d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac251d6-755d-4069-a253-25907d3dfec8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260]
Dec 05 13:40:33 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260] successful.
Dec 05 13:40:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d2ec5-05e2-42b2-925e-37348ea95803]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edaf4f-1e4e-4c12-baa7-66dc5f2f4ac4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:33 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:33 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd42f96b-edb1-4451-b739-b93e9bbdf984]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isNfaOoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG nova.compute.manager [req-f6acd426-3fce-4970-8a71-f15fe980bba2 req-b6d7876d-4eef-4834-af4f-b9f26278abb5 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f6acd426-3fce-4970-8a71-f15fe980bba2 req-b6d7876d-4eef-4834-af4f-b9f26278abb5 service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f6acd426-3fce-4970-8a71-f15fe980bba2 req-b6d7876d-4eef-4834-af4f-b9f26278abb5 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f6acd426-3fce-4970-8a71-f15fe980bba2 req-b6d7876d-4eef-4834-af4f-b9f26278abb5 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG nova.compute.manager [req-f6acd426-3fce-4970-8a71-f15fe980bba2 req-b6d7876d-4eef-4834-af4f-b9f26278abb5 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:34 user nova-compute[75233]: WARNING nova.compute.manager [req-f6acd426-3fce-4970-8a71-f15fe980bba2 req-b6d7876d-4eef-4834-af4f-b9f26278abb5 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state active and task_state rescuing.
Dec 05 13:40:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23137373464633431', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137373464633431', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.292s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:34 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:34 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ef4cbb-deb2-499f-8980-62498e8700fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:40:34 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtsMQvcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:34 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd49fbd-7a52-4f24-bd11-4d8ea4b6ac86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf] added
Dec 05 13:40:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f20dd-eaf3-40ab-a69e-d436e762433b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[420ab223-6362-4946-8630-f34651021c14]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzjTpDho {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzjTpDho" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd7f9f4-1dd1-4e86-aad9-fa4544081a58]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzjTpDho'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b472967-6232-451c-bbd5-ee9cf56b0335]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e582d-a99c-4f33-a809-7587e4b6ca90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9292424e-38fd-4c7e-968d-98ffa454e181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260]
Dec 05 13:40:34 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260] successful.
Dec 05 13:40:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e67cdc-fefe-4750-8c1b-e4ad5570799c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83183a-e79f-4ae0-9d7c-2e8ef451f155]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:34 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511b1c7-3f9d-4a03-b389-0ecebc363b9b]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:40:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzjTpDho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== connect_volume: return (2628ms) {'type': 'block', 'scsi_wwn': '26635306137396264', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635306137396264', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:35 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:35 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58669365-808b-432e-8364-433e6b3b40e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:40:35 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBjLNsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:35 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b8894f-d31c-4b99-bc8b-102fb87fd323]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460] added
Dec 05 13:40:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e4e9fb-1594-4228-b149-28e0706973d7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22388785-5609-45d5-9374-567333a9dcba]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtsMQvcg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtsMQvcg" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c445e9-7660-44a5-9e6d-ae27a800423d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wtsMQvcg'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234e198-0fe4-4eea-9daf-460d7a0dd90a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e6c41-1571-458c-8ba4-e72793ce6aed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:35 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:35 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:35 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:35 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd78cfc-2ecb-4b65-b3ec-e6670297eb3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260]
Dec 05 13:40:36 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260] successful.
Dec 05 13:40:36 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d1605-dc2a-4c71-8ec8-8e00f7052d6c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31fd66-c287-4adb-aa17-ee420074bfe4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:36 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:36 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:36 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:36 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:36 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:36 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:36 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:36 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd1d37-45c4-4490-920c-a1f8bc04fdf7]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtsMQvcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:36 user nova-compute[75233]: WARNING nova.compute.manager [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state active and task_state rescuing.
Dec 05 13:40:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:36 user nova-compute[75233]: WARNING nova.compute.manager [req-19fd9ce1-a682-4067-84b8-41498e3cb173 req-8f96dd69-68e5-451b-80cc-25471117cd9e service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state active and task_state rescuing.
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-061afb74-37bf-4c94-8b6f-6a24f5f192a9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== connect_volume: return (2593ms) {'type': 'block', 'scsi_wwn': '23934396235396434', 'path': '/dev/sde'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934396235396434', 'path': '/dev/sde'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.273s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:37 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:37 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f1349-bec0-4b4a-ad45-a75a042a8026]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:40:37 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjefnkIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:37 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[441cf192-3ab8-4b10-9540-60fea15f61e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854] added
Dec 05 13:40:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70c233c-a9e1-4703-aeda-af0f98b6f034]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39e20c-9e3e-4f98-b252-e0a21b8c622f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBjLNsga {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBjLNsga" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c707c2a1-9549-4dd7-8028-174556101338]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBjLNsga'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9f1930-a89d-4e41-bb90-72646778b22c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd32ec38-67b3-45d1-932b-f93833b57a64]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a852f1-ad66-4a8e-892a-117f02ed67a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260]
Dec 05 13:40:37 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260] successful.
Dec 05 13:40:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6726b9d-72d7-4143-a64b-6f0f8dfcdc53]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbc3912-344d-4e75-8ab0-766107fd5e08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7829c5d-3237-446b-9785-1ef1639c0d56]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:40:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBjLNsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== connect_volume: return (2605ms) {'type': 'block', 'scsi_wwn': '23132646364353033', 'path': '/dev/sdf'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132646364353033', 'path': '/dev/sdf'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:38 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a021218-db3a-44fb-8855-8653a41bd8a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:40:38 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHDsIfcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:40:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde5d0a-0a93-42ea-b7bb-73d92c58c65c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a] added
Dec 05 13:40:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be48b2f-0d29-4240-b1e8-18ea04d1833c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792abb2-67f9-469c-bd47-7099567f2f68]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjefnkIw {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjefnkIw" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b2d4b0-1cee-43e5-98bc-a71823aada09]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZjefnkIw'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d0901-573b-4759-b146-ce1232aa83a0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4466d402-74e2-4bb9-b2fa-e81faa72b35c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[190169b9-1c58-4550-b2cf-aff6482d5bfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260]
Dec 05 13:40:38 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260] successful.
Dec 05 13:40:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b51b14-eb6f-4c96-8302-a6de2009e734]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8965e559-8922-44db-ac5e-f5b9d468bfa4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:40:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:38 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:40:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8c3288-fe40-4fc9-bd59-b5cc64da327d]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjefnkIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:40:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== connect_volume: return (2739ms) {'type': 'block', 'scsi_wwn': '23939633931306537', 'path': '/dev/sdg'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939633931306537', 'path': '/dev/sdg'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.398s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:39 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:40:39 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d564d9-4e64-4345-b96a-7e6a6c7932c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:40:39 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a6e098-df9b-4d80-b239-a5c3483b1e6f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[321cd8cf-8396-44aa-b147-a67819482a98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33] added
Dec 05 13:40:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe15428-8ef3-4e2e-836b-3d510663d2d2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:40:40 user nova-compute[75233]:   <uuid>a1a6e098-df9b-4d80-b239-a5c3483b1e6f</uuid>
Dec 05 13:40:40 user nova-compute[75233]:   <name>instance-0000000b</name>
Dec 05 13:40:40 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:40:40 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:40:40 user nova-compute[75233]:   <metadata>
Dec 05 13:40:40 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:40:40 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:40:40 user nova-compute[75233]:       <nova:name>tempest-device-tagging-server-1732013876</nova:name>
Dec 05 13:40:40 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:40:33</nova:creationTime>
Dec 05 13:40:40 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:40:40 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:40:40 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:40:40 user nova-compute[75233]:       <nova:owner>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:user uuid="e3f1614c6f8b49c48d6fc69b2133c600">tempest-TaggedBootDevicesTest_v242-290263566-project-member</nova:user>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:project uuid="57b9175eaa564bc08df6a8f358865fee">tempest-TaggedBootDevicesTest_v242-290263566</nova:project>
Dec 05 13:40:40 user nova-compute[75233]:       </nova:owner>
Dec 05 13:40:40 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:40:40 user nova-compute[75233]:       <nova:ports>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="903392ae-faa6-42cc-aaaa-480aaf6f50e7">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="ac01118f-15bc-4182-af5f-73349fb26b3f">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="61f4b0a9-95e0-4752-97ba-47f8f5359e15">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="d5e8ae9b-9ee1-49d7-8bde-ef03158829c9">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="483a3a1b-0fdb-4a8f-97ca-16628a74672d">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="7061c9ce-8024-4f64-9572-a363bb470f95">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:         <nova:port uuid="fb1a68ef-58d9-48f4-a82d-6e7756b34818">
Dec 05 13:40:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 05 13:40:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:40 user nova-compute[75233]:       </nova:ports>
Dec 05 13:40:40 user nova-compute[75233]:     </nova:instance>
Dec 05 13:40:40 user nova-compute[75233]:   </metadata>
Dec 05 13:40:40 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:40:40 user nova-compute[75233]:     <system>
Dec 05 13:40:40 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:40:40 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:40:40 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:40:40 user nova-compute[75233]:       <entry name="serial">a1a6e098-df9b-4d80-b239-a5c3483b1e6f</entry>
Dec 05 13:40:40 user nova-compute[75233]:       <entry name="uuid">a1a6e098-df9b-4d80-b239-a5c3483b1e6f</entry>
Dec 05 13:40:40 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:40:40 user nova-compute[75233]:     </system>
Dec 05 13:40:40 user nova-compute[75233]:   </sysinfo>
Dec 05 13:40:40 user nova-compute[75233]:   <os>
Dec 05 13:40:40 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:40:40 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:40:40 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:40:40 user nova-compute[75233]:   </os>
Dec 05 13:40:40 user nova-compute[75233]:   <features>
Dec 05 13:40:40 user nova-compute[75233]:     <acpi/>
Dec 05 13:40:40 user nova-compute[75233]:     <apic/>
Dec 05 13:40:40 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:40:40 user nova-compute[75233]:   </features>
Dec 05 13:40:40 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:40:40 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:40:40 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:40:40 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:40:40 user nova-compute[75233]:   </clock>
Dec 05 13:40:40 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:40:40 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:40:40 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:40:40 user nova-compute[75233]:   </cpu>
Dec 05 13:40:40 user nova-compute[75233]:   <devices>
Dec 05 13:40:40 user nova-compute[75233]:     <disk type="file" device="cdrom">
Dec 05 13:40:40 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 13:40:40 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f/disk.config"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="hda" bus="ide"/>
Dec 05 13:40:40 user nova-compute[75233]:     </disk>
Dec 05 13:40:40 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:40:40 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:40:40 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <serial>a5399c35-f7eb-4e16-96c6-47a0f3329769</serial>
Dec 05 13:40:40 user nova-compute[75233]:     </disk>
Dec 05 13:40:40 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:40:40 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:40:40 user nova-compute[75233]:       <source dev="/dev/sde"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <serial>5f43d22f-52a4-4415-8793-2434aec5d460</serial>
Dec 05 13:40:40 user nova-compute[75233]:     </disk>
Dec 05 13:40:40 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:40:40 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:40:40 user nova-compute[75233]:       <source dev="/dev/sdg"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="vdc" bus="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <serial>bf704330-c22b-4921-9338-0e30467d551a</serial>
Dec 05 13:40:40 user nova-compute[75233]:     </disk>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:c7:3d:47"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tap903392ae-fa"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:8a:a5:03"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tapac01118f-15"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:68:b6:7d"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tap61f4b0a9-95"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:9c:57:8b"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tapd5e8ae9b-9e"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:ae:2d:a0"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tap483a3a1b-0f"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:02:ea:b8"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tap7061c9ce-80"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:40 user nova-compute[75233]:       <mac address="fa:16:3e:be:0e:cd"/>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:40 user nova-compute[75233]:       <target dev="tapfb1a68ef-58"/>
Dec 05 13:40:40 user nova-compute[75233]:     </interface>
Dec 05 13:40:40 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:40:40 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f/console.log" append="off"/>
Dec 05 13:40:40 user nova-compute[75233]:     </serial>
Dec 05 13:40:40 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:40:40 user nova-compute[75233]:     <video>
Dec 05 13:40:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:40 user nova-compute[75233]:     </video>
Dec 05 13:40:40 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:40:40 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:40:40 user nova-compute[75233]:     </rng>
Dec 05 13:40:40 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:40:40 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:40:40 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:40:40 user nova-compute[75233]:     </memballoon>
Dec 05 13:40:40 user nova-compute[75233]:   </devices>
Dec 05 13:40:40 user nova-compute[75233]: </domain>
Dec 05 13:40:40 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59917053-237a-5368-943b-636f35f3deda', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0683ba9-5bb2-4150-b433-f2430fbfdfe6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHDsIfcl {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903392ae-fa, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap903392ae-fa, col_values=(('qos', UUID('6d8d5346-429d-4a53-b50f-c23e90f8cf77')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap903392ae-fa, col_values=(('external_ids', {'iface-id': '903392ae-faa6-42cc-aaaa-480aaf6f50e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:3d:47', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHDsIfcl" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8613eb11-01c8-4015-92c1-b3437ab05481]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHDsIfcl'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5538b8c6-c70d-57a9-8038-4dfe1ebbc12e', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[281248a1-fd39-4dc7-9f97-82cca116f123]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac01118f-15, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac01118f-15, col_values=(('qos', UUID('8a4880aa-f345-42b4-a345-372f2fff16c5')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac01118f-15, col_values=(('external_ids', {'iface-id': 'ac01118f-15bc-4182-af5f-73349fb26b3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:a5:03', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1dd66-db16-4815-b13a-6e83a0f5ef6b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:40:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:40:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32952d8d-5c12-5069-840b-36c5b385a2a5', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61f4b0a9-95, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61f4b0a9-95, col_values=(('qos', UUID('702c5f27-5b87-4a28-81be-9c2f126d61bd')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61f4b0a9-95, col_values=(('external_ids', {'iface-id': '61f4b0a9-95e0-4752-97ba-47f8f5359e15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:b6:7d', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a6357-e12e-4610-ba05-913fe43df5db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260]
Dec 05 13:40:40 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260] successful.
Dec 05 13:40:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c6b03ed-2b56-5a35-aed2-ecd983d78b91', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f754106-3b28-487d-b2b8-59ae38b3863e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5e8ae9b-9e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5e8ae9b-9e, col_values=(('qos', UUID('444a4804-5685-4c9e-9a0c-a10e0295e5b8')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5e8ae9b-9e, col_values=(('external_ids', {'iface-id': 'd5e8ae9b-9ee1-49d7-8bde-ef03158829c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:57:8b', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3613ee0-b7be-4597-9db8-f3b140d502f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:40:40 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:40:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e5fcf8-9654-4336-9643-56d619183ecd]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHDsIfcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b61b1623-b6e0-595e-afdf-949ff6577b6f', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap483a3a1b-0f, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap483a3a1b-0f, col_values=(('qos', UUID('d97b423a-44da-4c39-bfab-e13ce316a9e6')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap483a3a1b-0f, col_values=(('external_ids', {'iface-id': '483a3a1b-0fdb-4a8f-97ca-16628a74672d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2d:a0', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b1b5844-15c5-54cc-bc49-411cd0291006', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7061c9ce-80, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7061c9ce-80, col_values=(('qos', UUID('95a28c63-38a5-49ae-ae5c-fc4fc23511f2')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7061c9ce-80, col_values=(('external_ids', {'iface-id': '7061c9ce-8024-4f64-9572-a363bb470f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ea:b8', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10424dcb-5a00-5314-ac3e-9aa7ed67bb94', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb1a68ef-58, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb1a68ef-58, col_values=(('qos', UUID('eaa79c7a-14cf-4c6c-9339-2756d7159482')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb1a68ef-58, col_values=(('external_ids', {'iface-id': 'fb1a68ef-58d9-48f4-a82d-6e7756b34818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0e:cd', 'vm-uuid': 'a1a6e098-df9b-4d80-b239-a5c3483b1e6f'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:40 user nova-compute[75233]: INFO os_vif [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58')
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] No BDM found with device name hda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] No VIF found with MAC fa:16:3e:c7:3d:47, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] No VIF found with MAC fa:16:3e:ae:2d:a0, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:40:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Using config drive
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Creating config drive at /opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f/disk.config
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp941w01t4 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp941w01t4" returned: 0 in 0.074s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== connect_volume: return (2809ms) {'type': 'block', 'scsi_wwn': '26137613862626637', 'path': '/dev/sdh'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137613862626637', 'path': '/dev/sdh'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.objects.instance [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lazy-loading 'pci_devices' on Instance uuid edbd6067-bd46-4f66-a10d-a01e36efca03 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:40:41 user nova-compute[75233]:   <uuid>edbd6067-bd46-4f66-a10d-a01e36efca03</uuid>
Dec 05 13:40:41 user nova-compute[75233]:   <name>instance-0000000c</name>
Dec 05 13:40:41 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:40:41 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:40:41 user nova-compute[75233]:   <metadata>
Dec 05 13:40:41 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:40:41 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:40:41 user nova-compute[75233]:       <nova:name>tempest-device-tagging-server-1232982107</nova:name>
Dec 05 13:40:41 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:40:33</nova:creationTime>
Dec 05 13:40:41 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:40:41 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:40:41 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:40:41 user nova-compute[75233]:       <nova:owner>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:user uuid="6b2069f5a667407ea5b92c2f605af2a3">tempest-TaggedBootDevicesTest-886833816-project-member</nova:user>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:project uuid="46ab2194e480431abd2d2e27aa394177">tempest-TaggedBootDevicesTest-886833816</nova:project>
Dec 05 13:40:41 user nova-compute[75233]:       </nova:owner>
Dec 05 13:40:41 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:40:41 user nova-compute[75233]:       <nova:ports>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="37916b1b-6c4a-458c-bb6e-c83241a127cc">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="3f0aba05-78aa-4a57-8dcb-078fce6c7784">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="d3dc4614-6e00-4a6a-9db8-d436f984d9a7">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="41f728b9-8d5c-4809-b371-67153855343c">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="08d1661e-06b3-4562-80fe-4b8fb15950a9">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="5fa00b5d-73c6-4493-9cb4-d4ae97598d51">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:         <nova:port uuid="97faf99e-f277-44f6-8ecb-dabef4c582b4">
Dec 05 13:40:41 user nova-compute[75233]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 05 13:40:41 user nova-compute[75233]:         </nova:port>
Dec 05 13:40:41 user nova-compute[75233]:       </nova:ports>
Dec 05 13:40:41 user nova-compute[75233]:     </nova:instance>
Dec 05 13:40:41 user nova-compute[75233]:   </metadata>
Dec 05 13:40:41 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:40:41 user nova-compute[75233]:     <system>
Dec 05 13:40:41 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:40:41 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:40:41 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:40:41 user nova-compute[75233]:       <entry name="serial">edbd6067-bd46-4f66-a10d-a01e36efca03</entry>
Dec 05 13:40:41 user nova-compute[75233]:       <entry name="uuid">edbd6067-bd46-4f66-a10d-a01e36efca03</entry>
Dec 05 13:40:41 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:40:41 user nova-compute[75233]:     </system>
Dec 05 13:40:41 user nova-compute[75233]:   </sysinfo>
Dec 05 13:40:41 user nova-compute[75233]:   <os>
Dec 05 13:40:41 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:40:41 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:40:41 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:40:41 user nova-compute[75233]:   </os>
Dec 05 13:40:41 user nova-compute[75233]:   <features>
Dec 05 13:40:41 user nova-compute[75233]:     <acpi/>
Dec 05 13:40:41 user nova-compute[75233]:     <apic/>
Dec 05 13:40:41 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:40:41 user nova-compute[75233]:   </features>
Dec 05 13:40:41 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:40:41 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:40:41 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:40:41 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:40:41 user nova-compute[75233]:   </clock>
Dec 05 13:40:41 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:40:41 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:40:41 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:40:41 user nova-compute[75233]:   </cpu>
Dec 05 13:40:41 user nova-compute[75233]:   <devices>
Dec 05 13:40:41 user nova-compute[75233]:     <disk type="file" device="cdrom">
Dec 05 13:40:41 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 13:40:41 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03/disk.config"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="hda" bus="ide"/>
Dec 05 13:40:41 user nova-compute[75233]:     </disk>
Dec 05 13:40:41 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:40:41 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:40:41 user nova-compute[75233]:       <source dev="/dev/sdd"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <serial>d958bdc4-575a-487d-9ce9-ba02c3e403cf</serial>
Dec 05 13:40:41 user nova-compute[75233]:     </disk>
Dec 05 13:40:41 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:40:41 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:40:41 user nova-compute[75233]:       <source dev="/dev/sdf"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <serial>18495a8b-3eb7-4b11-b971-c6860b5bf854</serial>
Dec 05 13:40:41 user nova-compute[75233]:     </disk>
Dec 05 13:40:41 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:40:41 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:40:41 user nova-compute[75233]:       <source dev="/dev/sdh"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="vdc" bus="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <serial>af942720-f286-43e3-aac7-6f8bc76bda33</serial>
Dec 05 13:40:41 user nova-compute[75233]:     </disk>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:76:d2:ae"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tap37916b1b-6c"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:bc:ed:ed"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tap3f0aba05-78"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:e6:41:e7"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tapd3dc4614-6e"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:d8:8f:66"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tap41f728b9-8d"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:13:e9:34"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tap08d1661e-06"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:79:72:7d"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tap5fa00b5d-73"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:40:41 user nova-compute[75233]:       <mac address="fa:16:3e:e6:bd:75"/>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:40:41 user nova-compute[75233]:       <target dev="tap97faf99e-f2"/>
Dec 05 13:40:41 user nova-compute[75233]:     </interface>
Dec 05 13:40:41 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:40:41 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03/console.log" append="off"/>
Dec 05 13:40:41 user nova-compute[75233]:     </serial>
Dec 05 13:40:41 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:40:41 user nova-compute[75233]:     <video>
Dec 05 13:40:41 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:40:41 user nova-compute[75233]:     </video>
Dec 05 13:40:41 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:40:41 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:40:41 user nova-compute[75233]:     </rng>
Dec 05 13:40:41 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:40:41 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:40:41 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:40:41 user nova-compute[75233]:     </memballoon>
Dec 05 13:40:41 user nova-compute[75233]:   </devices>
Dec 05 13:40:41 user nova-compute[75233]: </domain>
Dec 05 13:40:41 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7f6e5d3-9478-5940-b324-860615b60485', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37916b1b-6c, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37916b1b-6c, col_values=(('qos', UUID('190e42cd-12a3-4946-9d99-0aa908108b3b')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37916b1b-6c, col_values=(('external_ids', {'iface-id': '37916b1b-6c4a-458c-bb6e-c83241a127cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:d2:ae', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c')
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea64767e-eee4-553a-8d39-e2bbc5182772', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f0aba05-78, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f0aba05-78, col_values=(('qos', UUID('eb978339-d92f-4709-bd15-e29bb9d90aa6')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f0aba05-78, col_values=(('external_ids', {'iface-id': '3f0aba05-78aa-4a57-8dcb-078fce6c7784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:ed:ed', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78')
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08e354a2-ae08-5b93-a203-bba3c17aa609', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3dc4614-6e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3dc4614-6e, col_values=(('qos', UUID('816b7c8e-e151-4a27-b9e6-2dac52042d74')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3dc4614-6e, col_values=(('external_ids', {'iface-id': 'd3dc4614-6e00-4a6a-9db8-d436f984d9a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:41:e7', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e')
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01be8de4-517a-571d-a6b1-08063c11be8f', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41f728b9-8d, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41f728b9-8d, col_values=(('qos', UUID('ed2fd019-4c5f-4d9a-81f5-acc60fbaf89f')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41f728b9-8d, col_values=(('external_ids', {'iface-id': '41f728b9-8d5c-4809-b371-67153855343c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:8f:66', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d')
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '038016a3-3c92-54e5-b073-45536f429f63', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08d1661e-06, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08d1661e-06, col_values=(('qos', UUID('0fd37704-758b-4ac0-84ea-6c8bed9ee578')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08d1661e-06, col_values=(('external_ids', {'iface-id': '08d1661e-06b3-4562-80fe-4b8fb15950a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:e9:34', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06')
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd16806c0-53f3-524a-88b2-b1527efa6641', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fa00b5d-73, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fa00b5d-73, col_values=(('qos', UUID('445d2add-4250-4ca2-a116-1c697351027f')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fa00b5d-73, col_values=(('external_ids', {'iface-id': '5fa00b5d-73c6-4493-9cb4-d4ae97598d51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:72:7d', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73')
Dec 05 13:40:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d60360a-6053-5605-a9c3-ea930c861b64', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-efcb1fc6-cc9c-4626-994e-a2d95052f225 req-838e9bd9-8275-45b4-ac6e-d8b8bfd1e672 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-efcb1fc6-cc9c-4626-994e-a2d95052f225 req-838e9bd9-8275-45b4-ac6e-d8b8bfd1e672 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-efcb1fc6-cc9c-4626-994e-a2d95052f225 req-838e9bd9-8275-45b4-ac6e-d8b8bfd1e672 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-efcb1fc6-cc9c-4626-994e-a2d95052f225 req-838e9bd9-8275-45b4-ac6e-d8b8bfd1e672 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-efcb1fc6-cc9c-4626-994e-a2d95052f225 req-838e9bd9-8275-45b4-ac6e-d8b8bfd1e672 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:43 user nova-compute[75233]: WARNING nova.compute.manager [req-efcb1fc6-cc9c-4626-994e-a2d95052f225 req-838e9bd9-8275-45b4-ac6e-d8b8bfd1e672 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 for instance with vm_state building and task_state spawning.
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.850s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97faf99e-f2, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97faf99e-f2, col_values=(('qos', UUID('7894ebcb-2b3e-4746-bf7f-f86a09fad0bb')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97faf99e-f2, col_values=(('external_ids', {'iface-id': '97faf99e-f277-44f6-8ecb-dabef4c582b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:bd:75', 'vm-uuid': 'edbd6067-bd46-4f66-a10d-a01e36efca03'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:47 user nova-compute[75233]: INFO os_vif [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2')
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-f14a278c-be4d-4467-a0fe-b06380018b33 req-6112fb7b-a3f9-458a-bbb1-86e8e8dc83d1 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f14a278c-be4d-4467-a0fe-b06380018b33 req-6112fb7b-a3f9-458a-bbb1-86e8e8dc83d1 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f14a278c-be4d-4467-a0fe-b06380018b33 req-6112fb7b-a3f9-458a-bbb1-86e8e8dc83d1 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f14a278c-be4d-4467-a0fe-b06380018b33 req-6112fb7b-a3f9-458a-bbb1-86e8e8dc83d1 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-f14a278c-be4d-4467-a0fe-b06380018b33 req-6112fb7b-a3f9-458a-bbb1-86e8e8dc83d1 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-f14a278c-be4d-4467-a0fe-b06380018b33 req-6112fb7b-a3f9-458a-bbb1-86e8e8dc83d1 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-c4eacd5a-6852-4979-8c91-c8f96dbed01d req-b3ff1599-3f7e-4121-b0ca-9357e9a9f5ae service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c4eacd5a-6852-4979-8c91-c8f96dbed01d req-b3ff1599-3f7e-4121-b0ca-9357e9a9f5ae service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c4eacd5a-6852-4979-8c91-c8f96dbed01d req-b3ff1599-3f7e-4121-b0ca-9357e9a9f5ae service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c4eacd5a-6852-4979-8c91-c8f96dbed01d req-b3ff1599-3f7e-4121-b0ca-9357e9a9f5ae service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-c4eacd5a-6852-4979-8c91-c8f96dbed01d req-b3ff1599-3f7e-4121-b0ca-9357e9a9f5ae service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-c4eacd5a-6852-4979-8c91-c8f96dbed01d req-b3ff1599-3f7e-4121-b0ca-9357e9a9f5ae service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-f8b6e087-53c9-4f9a-9517-447946602f3a req-80dba35c-5e20-4dfd-aba6-2e8b0f9d91a0 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f8b6e087-53c9-4f9a-9517-447946602f3a req-80dba35c-5e20-4dfd-aba6-2e8b0f9d91a0 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f8b6e087-53c9-4f9a-9517-447946602f3a req-80dba35c-5e20-4dfd-aba6-2e8b0f9d91a0 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f8b6e087-53c9-4f9a-9517-447946602f3a req-80dba35c-5e20-4dfd-aba6-2e8b0f9d91a0 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-f8b6e087-53c9-4f9a-9517-447946602f3a req-80dba35c-5e20-4dfd-aba6-2e8b0f9d91a0 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-f8b6e087-53c9-4f9a-9517-447946602f3a req-80dba35c-5e20-4dfd-aba6-2e8b0f9d91a0 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-d7ac4f39-e835-40ab-a0b1-0b314bfd5db7 req-f6366312-5668-4eda-8383-cb1f48a3ea8c service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-31a7f122-bed2-4dc2-a1c1-135576555cd6 req-bc054200-4d7c-4dfd-9e3e-f9ad15083903 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.compute.manager [req-b462ddee-4e88-429c-adce-ab3cbc9f246f req-29bb50c9-e93d-4d7d-bee7-5d494ca57a66 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 for instance with vm_state building and task_state spawning.
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7020MB free_disk=25.284095764160156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:47 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance spawned successfully.
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:48 user nova-compute[75233]: INFO nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Took 15.03 seconds to spawn the instance on the hypervisor.
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] No BDM found with device name hda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] No VIF found with MAC fa:16:3e:76:d2:ae, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] No VIF found with MAC fa:16:3e:13:e9:34, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:40:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Using config drive
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 63978594-a36a-47f8-a596-4e6c1b965e7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 61b72e12-781d-472c-841d-59cacd38578f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 82f774ff-049f-4504-9fd0-b526079a13d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 885d9ddc-a084-472d-9422-5c93f549090d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a1a6e098-df9b-4d80-b239-a5c3483b1e6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance edbd6067-bd46-4f66-a10d-a01e36efca03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 293626c1-0760-43ab-8a9b-ebf0a659fb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:40:48 user nova-compute[75233]: INFO nova.compute.manager [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Took 49.92 seconds to build instance.
Dec 05 13:40:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3fce7acf-b2c9-4268-a53a-001d12f3f41d tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.106s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Creating config drive at /opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03/disk.config
Dec 05 13:40:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdgg3zok_ {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdgg3zok_" returned: 0 in 0.069s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.678s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing instance network info cache due to event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updated VIF entry in instance network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-343a75c4-5fe0-4a44-9e42-859bfa1bd761 req-6725645e-b4ea-4f16-abfd-2ae8d7d3defe service nova] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:40:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:40:49 user nova-compute[75233]: INFO nova.compute.manager [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] instance snapshotting
Dec 05 13:40:49 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Beginning live snapshot process
Dec 05 13:40:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.203s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdn19xu5s/d8c32bf2b295471f8222470c987f0703.delta 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:50 user nova-compute[75233]: WARNING nova.compute.manager [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc for instance with vm_state building and task_state spawning.
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:50 user nova-compute[75233]: WARNING nova.compute.manager [req-cb1c3a8b-7a60-49b9-812f-b312be62c334 req-1e96c70a-7e5c-4c40-903c-cd5384e6d64e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc for instance with vm_state building and task_state spawning.
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-aaed7e3f-7abf-4fed-8cf8-3e5ae7a825d6 req-285be36c-34e9-40d9-bd2f-8243d5daa9d5 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aaed7e3f-7abf-4fed-8cf8-3e5ae7a825d6 req-285be36c-34e9-40d9-bd2f-8243d5daa9d5 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aaed7e3f-7abf-4fed-8cf8-3e5ae7a825d6 req-285be36c-34e9-40d9-bd2f-8243d5daa9d5 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aaed7e3f-7abf-4fed-8cf8-3e5ae7a825d6 req-285be36c-34e9-40d9-bd2f-8243d5daa9d5 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-aaed7e3f-7abf-4fed-8cf8-3e5ae7a825d6 req-285be36c-34e9-40d9-bd2f-8243d5daa9d5 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:50 user nova-compute[75233]: WARNING nova.compute.manager [req-aaed7e3f-7abf-4fed-8cf8-3e5ae7a825d6 req-285be36c-34e9-40d9-bd2f-8243d5daa9d5 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 for instance with vm_state building and task_state spawning.
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdn19xu5s/d8c32bf2b295471f8222470c987f0703.delta 1073741824" returned: 0 in 0.102s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:50 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 13:40:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75233) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 05 13:40:50 user nova-compute[75233]: INFO nova.virt.libvirt.host [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] UEFI support detected
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-b722c9e6-340e-4cd5-88be-9d078f302398 req-ba14de59-3746-4181-81a7-43c8ed9bcbb1 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b722c9e6-340e-4cd5-88be-9d078f302398 req-ba14de59-3746-4181-81a7-43c8ed9bcbb1 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b722c9e6-340e-4cd5-88be-9d078f302398 req-ba14de59-3746-4181-81a7-43c8ed9bcbb1 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b722c9e6-340e-4cd5-88be-9d078f302398 req-ba14de59-3746-4181-81a7-43c8ed9bcbb1 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-b722c9e6-340e-4cd5-88be-9d078f302398 req-ba14de59-3746-4181-81a7-43c8ed9bcbb1 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:51 user nova-compute[75233]: WARNING nova.compute.manager [req-b722c9e6-340e-4cd5-88be-9d078f302398 req-ba14de59-3746-4181-81a7-43c8ed9bcbb1 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c for instance with vm_state building and task_state spawning.
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] COPY block job progress, current cursor: 1245184 final cursor: 75497472 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:40:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:40:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdn19xu5s/d8c32bf2b295471f8222470c987f0703.delta /opt/stack/data/nova/instances/snapshots/tmpdn19xu5s/d8c32bf2b295471f8222470c987f0703 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:52 user nova-compute[75233]: WARNING nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 for instance with vm_state building and task_state spawning.
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:52 user nova-compute[75233]: WARNING nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 for instance with vm_state building and task_state spawning.
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:52 user nova-compute[75233]: WARNING nova.compute.manager [req-2ac03233-086f-4147-a8cb-eca55ac67db8 req-e1f3bad1-af30-4d97-ac55-b03a646cd99e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 for instance with vm_state building and task_state spawning.
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-20f9b037-eece-4eb9-9b0a-49a525a9baa0 req-b1d76c90-8d8d-4844-bd94-f01dcc6d8e29 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-20f9b037-eece-4eb9-9b0a-49a525a9baa0 req-b1d76c90-8d8d-4844-bd94-f01dcc6d8e29 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-20f9b037-eece-4eb9-9b0a-49a525a9baa0 req-b1d76c90-8d8d-4844-bd94-f01dcc6d8e29 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-20f9b037-eece-4eb9-9b0a-49a525a9baa0 req-b1d76c90-8d8d-4844-bd94-f01dcc6d8e29 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-20f9b037-eece-4eb9-9b0a-49a525a9baa0 req-b1d76c90-8d8d-4844-bd94-f01dcc6d8e29 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:52 user nova-compute[75233]: WARNING nova.compute.manager [req-20f9b037-eece-4eb9-9b0a-49a525a9baa0 req-b1d76c90-8d8d-4844-bd94-f01dcc6d8e29 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 for instance with vm_state building and task_state spawning.
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdn19xu5s/d8c32bf2b295471f8222470c987f0703.delta /opt/stack/data/nova/instances/snapshots/tmpdn19xu5s/d8c32bf2b295471f8222470c987f0703" returned: 0 in 0.493s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:40:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Snapshot extracted, beginning image upload
Dec 05 13:40:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:53 user nova-compute[75233]: WARNING nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c for instance with vm_state building and task_state spawning.
Dec 05 13:40:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:53 user nova-compute[75233]: WARNING nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 for instance with vm_state building and task_state spawning.
Dec 05 13:40:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:53 user nova-compute[75233]: WARNING nova.compute.manager [req-07f967ef-e4a8-4cb5-a61e-7d17849e843c req-c88533df-a2e0-4d42-9ffd-13077a2ceba8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 for instance with vm_state building and task_state spawning.
Dec 05 13:40:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:54 user nova-compute[75233]: WARNING nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 for instance with vm_state building and task_state spawning.
Dec 05 13:40:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:54 user nova-compute[75233]: WARNING nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 for instance with vm_state building and task_state spawning.
Dec 05 13:40:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:40:54 user nova-compute[75233]: WARNING nova.compute.manager [req-592d3f4e-6f19-4fd4-9794-ab98de50e2b7 req-32e6293a-7df9-490f-bea8-b022f2ab17f9 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 for instance with vm_state building and task_state spawning.
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:40:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance spawned successfully.
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:40:55 user nova-compute[75233]: INFO nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Took 22.32 seconds to spawn the instance on the hypervisor.
Dec 05 13:40:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:40:55 user nova-compute[75233]: INFO nova.compute.manager [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Took 57.28 seconds to build instance.
Dec 05 13:40:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-039de18e-2548-44f5-ac05-e3abc415b955 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 57.463s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:40:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Snapshot image upload complete
Dec 05 13:40:55 user nova-compute[75233]: INFO nova.compute.manager [None req-e76b6fa1-5eee-4d0d-bf4a-bd5468c90ee6 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Took 6.10 seconds to snapshot the instance on the hypervisor.
Dec 05 13:40:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:40:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-changed-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Refreshing instance network info cache due to event network-changed-b0eee427-11d4-4575-aeee-33db56579d43. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] Acquiring lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] Acquired lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:00 user nova-compute[75233]: DEBUG nova.network.neutron [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Refreshing network info cache for port b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:01 user nova-compute[75233]: DEBUG nova.network.neutron [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updated VIF entry in instance network info cache for port b0eee427-11d4-4575-aeee-33db56579d43. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:01 user nova-compute[75233]: DEBUG nova.network.neutron [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updating instance_info_cache with network_info: [{"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-325cc747-e115-405d-8322-9a34aaf42b14 req-e18f17cb-04dc-409c-9505-c52473fabe29 service nova] Releasing lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'flavor' on Instance uuid 63978594-a36a-47f8-a596-4e6c1b965e7c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.145s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:03 user nova-compute[75233]: INFO nova.compute.manager [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Attaching volume fd13f867-4a77-4023-a341-248c7a1000d4 to /dev/vdb
Dec 05 13:41:04 user nova-compute[75233]: DEBUG os_brick.utils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.097s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441ece0-31ba-41de-9222-be6abe5b8250]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0fe55-678e-4b60-837a-91d0c0feb291]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd53ce3-77e4-4e71-8400-077fdef926d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d79870-a7e3-43e2-931e-b1ca9eb5fc88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:04 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d939fbd1-80e8-4c65-8ad3-c3c2f20b6994]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG os_brick.utils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:04 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updating existing volume attachment record: 89edf775-9a0c-4837-a883-c569ed070394 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-changed-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Refreshing instance network info cache due to event network-changed-643f12d8-3bd8-4a62-9bc4-260af906a6e3. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] Acquiring lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] Acquired lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Refreshing network info cache for port 643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lazy-loading 'flavor' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updated VIF entry in instance network info cache for port 643f12d8-3bd8-4a62-9bc4-260af906a6e3. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updating instance_info_cache with network_info: [{"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0b4b6369-8023-4bfd-9d87-fdd4bbc532d8 req-29410822-f3b6-4350-a123-81243df75e9d service nova] Releasing lock "refresh_cache-61b72e12-781d-472c-841d-59cacd38578f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:07 user nova-compute[75233]: INFO nova.compute.manager [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Attaching volume a78ebbc6-fd4d-45b7-a525-c79b826f4342 to /dev/vdb
Dec 05 13:41:08 user nova-compute[75233]: DEBUG os_brick.utils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9378f12-28de-441d-acaf-ac08259c04f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd41526-2873-4780-b190-30dbc2750e51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[708e0f75-be7b-4d8e-a8aa-5eeebf1e78b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8554d59f-9cfc-4c86-a01f-9df9089a0556]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:08 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:08 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75380445-469f-4326-bb96-990371c77555]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG os_brick.utils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updating existing volume attachment record: e1979286-6170-45a1-b9a0-3978aeb56257 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-changed-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Refreshing instance network info cache due to event network-changed-fd294db6-58bd-49b8-85bf-560b9253421c. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] Acquiring lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] Acquired lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Refreshing network info cache for port fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Updated VIF entry in instance network info cache for port fd294db6-58bd-49b8-85bf-560b9253421c. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Updating instance_info_cache with network_info: [{"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-af5aab08-c615-45b1-8893-10a5cadbb300 req-ac4c0bcb-1971-4368-b612-4204c49622ff service nova] Releasing lock "refresh_cache-e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:11 user nova-compute[75233]: DEBUG nova.objects.instance [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lazy-loading 'flavor' on Instance uuid e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:12 user nova-compute[75233]: INFO nova.compute.manager [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Attaching volume 11539e50-cb7c-4799-89f2-90dfd924b3fd to /dev/sdc
Dec 05 13:41:12 user nova-compute[75233]: DEBUG os_brick.utils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa7f2c-ea3d-4adc-9f30-b8b839580859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92607bc9-d73e-4f30-a79b-d96223b2b782]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea5d17-21fd-4d5b-ad4f-ec6d3073ca85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad63c7-a712-4499-9d63-a0f6df9c0c84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:12 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54217b9-8276-4722-8d90-685caa3a5fd0]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG os_brick.utils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:12 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Updating existing volume attachment record: 0554d599-a541-4770-9d2c-2def24b51c7d {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-changed-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Refreshing instance network info cache due to event network-changed-1ad882c8-81f9-48ed-a978-734805dd9564. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] Acquiring lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] Acquired lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Refreshing network info cache for port 1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "interface-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "interface-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'flavor' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updated VIF entry in instance network info cache for port 1ad882c8-81f9-48ed-a978-734805dd9564. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-50fc2a1b-978b-4a2f-8b15-3847409b38ab req-34d183b4-aacc-4620-9ee2-98f50d69384c service nova] Releasing lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'pci_requests' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.objects.base [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Object Instance<cf62dc1b-8a7e-48ac-88e7-420ce6b9851c> lazy-loaded attributes: flavor,pci_requests {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG nova.policy [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b7c7ad4b6e3420eb9b1458993a83420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f74e2293c74d82b37d4bdd6c9db8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Successfully created port: 35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Successfully updated port: 35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquired lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-changed-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Refreshing instance network info cache due to event network-changed-35026b32-2e65-4fe9-8e7f-0728c86624e1. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] Acquiring lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Releasing lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] Acquired lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Refreshing network info cache for port 35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG os_vif [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f579c9c-c2c5-5f1c-a1db-bdd7891ed0a5', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35026b32-2e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35026b32-2e, col_values=(('qos', UUID('57a9de82-6cb2-4637-8748-3a3d030e37e9')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35026b32-2e, col_values=(('external_ids', {'iface-id': '35026b32-2e65-4fe9-8e7f-0728c86624e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:c8:bf', 'vm-uuid': 'cf62dc1b-8a7e-48ac-88e7-420ce6b9851c'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: INFO os_vif [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e')
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] attach device xml: <interface type="ethernet">
Dec 05 13:41:15 user nova-compute[75233]:   <mac address="fa:16:3e:f1:c8:bf"/>
Dec 05 13:41:15 user nova-compute[75233]:   <model type="virtio"/>
Dec 05 13:41:15 user nova-compute[75233]:   <mtu size="1442"/>
Dec 05 13:41:15 user nova-compute[75233]:   <target dev="tap35026b32-2e"/>
Dec 05 13:41:15 user nova-compute[75233]: </interface>
Dec 05 13:41:15 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updated VIF entry in instance network info cache for port 35026b32-2e65-4fe9-8e7f-0728c86624e1. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7f75ccc9-0987-4551-b7aa-db679da3c98f req-ad28418f-15ac-46c6-9c80-67556d1cdc66 service nova] Releasing lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-78d7f179-4879-428f-8ec6-668c26f67a0a req-da1d4c65-2999-4ddb-9575-db687460e2d6 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-78d7f179-4879-428f-8ec6-668c26f67a0a req-da1d4c65-2999-4ddb-9575-db687460e2d6 service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-78d7f179-4879-428f-8ec6-668c26f67a0a req-da1d4c65-2999-4ddb-9575-db687460e2d6 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-78d7f179-4879-428f-8ec6-668c26f67a0a req-da1d4c65-2999-4ddb-9575-db687460e2d6 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-78d7f179-4879-428f-8ec6-668c26f67a0a req-da1d4c65-2999-4ddb-9575-db687460e2d6 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:16 user nova-compute[75233]: WARNING nova.compute.manager [req-78d7f179-4879-428f-8ec6-668c26f67a0a req-da1d4c65-2999-4ddb-9575-db687460e2d6 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 for instance with vm_state active and task_state None.
Dec 05 13:41:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGknDVqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:16 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:16 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:16 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def4fbc-b665-429c-bba2-fe0d7934b245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:16 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.068s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac370e-93a5-4f52-9ec6-e1cf84df2884]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4] added
Dec 05 13:41:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e03ea04-7ffd-4366-bd6a-5d2e029f4a3c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No BDM found with device name hda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No VIF found with MAC fa:16:3e:73:8c:03, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22d944-101b-4ca4-8dc8-9da73d57c340]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGknDVqI {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:41:16 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:41:16 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:41:16 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:41:16</nova:creationTime>
Dec 05 13:41:16 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:41:16 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:41:16 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:41:16 user nova-compute[75233]:   <nova:owner>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:41:16 user nova-compute[75233]:   </nova:owner>
Dec 05 13:41:16 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:41:16 user nova-compute[75233]:   <nova:ports>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:41:16 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:41:16 user nova-compute[75233]:     </nova:port>
Dec 05 13:41:16 user nova-compute[75233]:     <nova:port uuid="35026b32-2e65-4fe9-8e7f-0728c86624e1">
Dec 05 13:41:16 user nova-compute[75233]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Dec 05 13:41:16 user nova-compute[75233]:     </nova:port>
Dec 05 13:41:16 user nova-compute[75233]:   </nova:ports>
Dec 05 13:41:16 user nova-compute[75233]: </nova:instance>
Dec 05 13:41:16 user nova-compute[75233]:  {{(pid=75233) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGknDVqI" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5e0b1f-9c3c-4d7e-be87-e6f7d2e1a521]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rGknDVqI'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef625f57-2f40-4869-926f-4eee7812e256]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06d6f7d5-e559-462c-8d30-96c45770fa00 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "interface-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.364s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a572c0-c27f-4f29-a73b-aa79ef5aec8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:16 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb65213-b867-4f2f-8d15-1261228f761e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260]
Dec 05 13:41:16 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eb7981-c3f8-4999-88ef-68846a14f31d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[093c5b4f-f401-487c-9c5e-594875dc5362]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:17 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed689e-6506-47e4-9a8a-5119a10affc6]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGknDVqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG nova.objects.instance [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'flavor' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:17 user nova-compute[75233]: INFO nova.compute.manager [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Attaching volume 457f3110-a7a4-41c8-86c1-989890f0bd14 to /dev/vdb
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.utils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a033a35-ec36-4769-bfad-771056123113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db2bc72-8c8a-4009-ab03-472365e83091]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c047e-b8bf-4acc-9315-8d3f85f714d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa079d-e3b3-42b8-b44c-c6c9e145d05b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:17 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[755036a5-16ac-488a-8102-bb3d07b86454]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG os_brick.utils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:17 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating existing volume attachment record: 2eb6123a-4b82-4ec0-93e4-486cfaea61af {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] <== connect_volume: return (1516ms) {'type': 'block', 'scsi_wwn': '26638306264353733', 'path': '/dev/sdi'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638306264353733', 'path': '/dev/sdi'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'flavor' on Instance uuid 63978594-a36a-47f8-a596-4e6c1b965e7c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:41:18 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:18 user nova-compute[75233]:   <source dev="/dev/sdi"/>
Dec 05 13:41:18 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:18 user nova-compute[75233]:   <serial>fd13f867-4a77-4023-a341-248c7a1000d4</serial>
Dec 05 13:41:18 user nova-compute[75233]: </disk>
Dec 05 13:41:18 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-1fb1edc1-5470-48b5-9c0f-b6411108f9ba req-0023b8b2-199c-4f1b-895d-ac0251f4a3e3 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1fb1edc1-5470-48b5-9c0f-b6411108f9ba req-0023b8b2-199c-4f1b-895d-ac0251f4a3e3 service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1fb1edc1-5470-48b5-9c0f-b6411108f9ba req-0023b8b2-199c-4f1b-895d-ac0251f4a3e3 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1fb1edc1-5470-48b5-9c0f-b6411108f9ba req-0023b8b2-199c-4f1b-895d-ac0251f4a3e3 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-1fb1edc1-5470-48b5-9c0f-b6411108f9ba req-0023b8b2-199c-4f1b-895d-ac0251f4a3e3 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:18 user nova-compute[75233]: WARNING nova.compute.manager [req-1fb1edc1-5470-48b5-9c0f-b6411108f9ba req-0023b8b2-199c-4f1b-895d-ac0251f4a3e3 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 for instance with vm_state active and task_state None.
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No VIF found with MAC fa:16:3e:03:59:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-changed-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Refreshing instance network info cache due to event network-changed-184f8015-da2f-409e-832c-09c3c81a1e7e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] Acquiring lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] Acquired lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG nova.network.neutron [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Refreshing network info cache for port 184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updated VIF entry in instance network info cache for port 184f8015-da2f-409e-832c-09c3c81a1e7e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updating instance_info_cache with network_info: [{"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f2a4de17-01e7-458a-a070-3a476dd52fc8 req-b174881c-4527-4d89-9684-b5b687a243f4 service nova] Releasing lock "refresh_cache-82f774ff-049f-4504-9fd0-b526079a13d5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:19 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:19 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:19 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b171ae-6b72-40e0-8099-739dc516cb26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:19 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a1587-f7af-4869-911d-39c886670ebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342] added
Dec 05 13:41:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4266b9fc-7254-4cca-bdfa-6aaca203f70f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bbb766-6616-47fc-9f45-45fe53e209f0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6bd80d1c-4fef-429d-a295-bdb28bf97a22 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.133s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFSNsOqU {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFSNsOqU" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe37364-5950-4d9c-88f5-39dc06e7e95d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFSNsOqU'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e8c02b-4214-438f-a659-a3580b363faa]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bed5a0-d9a1-485f-8574-e0621ff53ecc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lazy-loading 'flavor' on Instance uuid 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aea5e9-88ec-478e-bb1a-c8bbe8ea3aab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]
Dec 05 13:41:20 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a6c27-34fd-4999-b902-3d7b2cc0a5fc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8653e8-a637-4e6a-8925-3ad0233be99a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8438f26-69ce-4536-a32e-9b96210f5fb7]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:20 user nova-compute[75233]: INFO nova.compute.manager [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Attaching volume c203460b-2847-444f-b3b0-e9d0ace4d7f2 to /dev/vdb
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.utils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc9744-e7c6-422a-ab9a-04f671118403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c9267-e5ef-4fb0-b5fc-a1f55091ea49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[107fff06-4965-484f-a1a5-b62f8c120270]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b821a1-5496-4479-bb34-506e7ca53285]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:20 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c40068a-4a2a-45a1-8c3f-b806182742f5]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG os_brick.utils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updating existing volume attachment record: d2240526-a736-470f-8c72-7b76029ec2d2 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23933656633323938', 'path': '/dev/sdj'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933656633323938', 'path': '/dev/sdj'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lazy-loading 'flavor' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:41:21 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:21 user nova-compute[75233]:   <source dev="/dev/sdj"/>
Dec 05 13:41:21 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:21 user nova-compute[75233]:   <serial>a78ebbc6-fd4d-45b7-a525-c79b826f4342</serial>
Dec 05 13:41:21 user nova-compute[75233]: </disk>
Dec 05 13:41:21 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-changed-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Refreshing instance network info cache due to event network-changed-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] Acquiring lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] Acquired lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.network.neutron [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Refreshing network info cache for port 2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] No VIF found with MAC fa:16:3e:33:1d:60, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updated VIF entry in instance network info cache for port 2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updating instance_info_cache with network_info: [{"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8757be46-073b-4f44-91f2-20f3f97b0c14 req-a9d6f65b-003c-4539-b115-154705d0389e service nova] Releasing lock "refresh_cache-0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjFEHoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:24 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:24 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:24 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a942d-55ab-4da1-8e13-8b467c992b1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:24 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc4fac-61ed-4f96-b58c-13009fd2cf0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd] added
Dec 05 13:41:24 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d567b9fc-28dc-4bea-9d10-8b45f8a71f5c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbde2541-5b8b-4317-b434-2519a37b4346]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMjFEHoB {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMjFEHoB" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e6e4f-7b44-4f1c-a790-d9f03ac7b6d6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bMjFEHoB'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d8503-e439-473e-b2b8-d49b25ca6ecc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be0b38-7f36-4c07-82ec-041bd0a0cbe6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:24 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8bcb75bd-ff79-47ba-b2e3-d05df2f9311a tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.970s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d6ffd-34cd-4251-b831-ae67f823822c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260]
Dec 05 13:41:24 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:24 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[82888952-0566-4bca-bc1c-1614a1e53fee]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3747233-3717-46cd-a15d-5cfd868e615f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e9a96-e097-4d77-8904-0431fc9e541d]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjFEHoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:25 user nova-compute[75233]: INFO nova.compute.manager [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Detaching volume fd13f867-4a77-4023-a341-248c7a1000d4
Dec 05 13:41:25 user nova-compute[75233]: INFO nova.virt.block_device [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Attempting to driver detach volume fd13f867-4a77-4023-a341-248c7a1000d4 from mountpoint /dev/vdb
Dec 05 13:41:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Attempting to detach device vdb from instance 63978594-a36a-47f8-a596-4e6c1b965e7c from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:25 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:25 user nova-compute[75233]:   <source dev="/dev/sdi"/>
Dec 05 13:41:25 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:25 user nova-compute[75233]:   <serial>fd13f867-4a77-4023-a341-248c7a1000d4</serial>
Dec 05 13:41:25 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:41:25 user nova-compute[75233]: </disk>
Dec 05 13:41:25 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Successfully detached device vdb from instance 63978594-a36a-47f8-a596-4e6c1b965e7c from the persistent domain config.
Dec 05 13:41:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63978594-a36a-47f8-a596-4e6c1b965e7c from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:25 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:25 user nova-compute[75233]:   <source dev="/dev/sdi"/>
Dec 05 13:41:25 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:25 user nova-compute[75233]:   <serial>fd13f867-4a77-4023-a341-248c7a1000d4</serial>
Dec 05 13:41:25 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:41:25 user nova-compute[75233]: </disk>
Dec 05 13:41:25 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:25 user nova-compute[75233]: INFO nova.compute.manager [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Rebuilding instance
Dec 05 13:41:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:41:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63978594-a36a-47f8-a596-4e6c1b965e7c {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23666626435363063', 'path': '/dev/sdk'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666626435363063', 'path': '/dev/sdk'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lazy-loading 'flavor' on Instance uuid e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:41:26 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:26 user nova-compute[75233]:   <source dev="/dev/sdk"/>
Dec 05 13:41:26 user nova-compute[75233]:   <target dev="sdc" bus="scsi"/>
Dec 05 13:41:26 user nova-compute[75233]:   <serial>11539e50-cb7c-4799-89f2-90dfd924b3fd</serial>
Dec 05 13:41:26 user nova-compute[75233]:   <address type="drive" controller="0" unit="2"/>
Dec 05 13:41:26 user nova-compute[75233]: </disk>
Dec 05 13:41:26 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-6427067e-91c9-4396-acd5-801266c24dbb req-03c1a32d-06ba-4244-b8da-618319d612a1 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-unplugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6427067e-91c9-4396-acd5-801266c24dbb req-03c1a32d-06ba-4244-b8da-618319d612a1 service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6427067e-91c9-4396-acd5-801266c24dbb req-03c1a32d-06ba-4244-b8da-618319d612a1 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6427067e-91c9-4396-acd5-801266c24dbb req-03c1a32d-06ba-4244-b8da-618319d612a1 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-6427067e-91c9-4396-acd5-801266c24dbb req-03c1a32d-06ba-4244-b8da-618319d612a1 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-unplugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:26 user nova-compute[75233]: WARNING nova.compute.manager [req-6427067e-91c9-4396-acd5-801266c24dbb req-03c1a32d-06ba-4244-b8da-618319d612a1 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-unplugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state active and task_state rebuilding.
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.utils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d0c9c-6c05-4d3a-8d66-6495c364b50c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a932e2b2-23b6-43a2-8d7b-ba39e6f90078]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a638f4-7434-4474-b65d-8cc34a974737]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8f1bf9-fc36-4a41-85b6-7031bbfdd60d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:26 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cacafb-7b02-4082-a5c3-4b046ff86aa2]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.utils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No BDM found with device name sda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] No VIF found with MAC fa:16:3e:15:00:5d, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:26 user nova-compute[75233]: INFO nova.compute.manager [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Swapping volume a78ebbc6-fd4d-45b7-a525-c79b826f4342 for 94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:41:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance destroyed successfully.
Dec 05 13:41:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance destroyed successfully.
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1541058515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-198484875',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBjirTdgwguXf8pJpDGH38q17eBDHncaQ+iB6D3hlb+s4hJpshKYtlQvlsbwGbpt6MhXarCfCtSdWaWLFu4ehJfgNc1TbGggoGeDFMM241T3aOm8pSjB5QSszJrkc/AA==',key_name='tempest-keypair-791952996',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e4d0d8d26d14eebac1d61089119a062',ramdisk_id='',reservation_id='r-5tvy1x7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1073184207',owner_user_name='tempest-ServerActionsV293TestJSON-1073184207-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158e2993042b45339f98fc5fff0aaf2c',uuid=0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converting VIF {"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a9a4a9a-4a, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f307db62-da2f-473a-b029-681b820061a6) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:26 user nova-compute[75233]: INFO os_vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a')
Dec 05 13:41:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-003ab141-79ad-4099-b23e-ba2585c3d20b tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.624s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0c860-9596-4848-a856-dffddff8faad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:41:26 user nova-compute[75233]: No targets found.
Dec 05 13:41:26 user nova-compute[75233]: iSNS:
Dec 05 13:41:26 user nova-compute[75233]: No targets found.
Dec 05 13:41:26 user nova-compute[75233]: STATIC:
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:41:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:26 user nova-compute[75233]: FIRMWARE:
Dec 05 13:41:26 user nova-compute[75233]: No targets found.
Dec 05 13:41:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:41:26 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:41:26 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67a2d9-a669-4946-82b2-7518d6e39a1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b80819-8ce5-4a73-b0bd-526cc60f33cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586588b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef92a00c-df58-4fbc-add1-fc9b0f231706]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43322d-9322-46ca-9ceb-f2bc7b8e9d0e]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac8220-e85b-4f8d-8d1e-55bf34405ada]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2447ec11-7b4e-42e7-b6fb-e59d2173b46e]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23135316337663434', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b92a2de6', '/dev/disk/by-id/scsi-1SCST_BIOb92a2de6-151c7f4450a113b0') {{(pid=86205) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b510c5-7203-4017-bf6d-08b01cee7e28]: (4, None) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d20a4c-eab3-44b3-9d8b-f39b05525907]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[662a09b9-74d4-441f-a65b-0e664d2c1a8a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]
Dec 05 13:41:27 user nova-compute[75233]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea1e06-1dfe-4025-b7b7-16e9a0c91769]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== disconnect_volume: return (412ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:41:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Deleting instance files /opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5_del
Dec 05 13:41:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Deletion of /opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5_del complete
Dec 05 13:41:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-0420b2a3-599a-4e77-85a4-658db142009a req-30980dea-a509-4462-a2dc-9c2f4eeb68a4 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0420b2a3-599a-4e77-85a4-658db142009a req-30980dea-a509-4462-a2dc-9c2f4eeb68a4 service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0420b2a3-599a-4e77-85a4-658db142009a req-30980dea-a509-4462-a2dc-9c2f4eeb68a4 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0420b2a3-599a-4e77-85a4-658db142009a req-30980dea-a509-4462-a2dc-9c2f4eeb68a4 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-0420b2a3-599a-4e77-85a4-658db142009a req-30980dea-a509-4462-a2dc-9c2f4eeb68a4 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:28 user nova-compute[75233]: WARNING nova.compute.manager [req-0420b2a3-599a-4e77-85a4-658db142009a req-30980dea-a509-4462-a2dc-9c2f4eeb68a4 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state active and task_state rebuilding.
Dec 05 13:41:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxUsjGZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:29 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:29 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:29 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f142a99c-e028-41bf-883c-238b7ac923c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:29 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20c4da4-a164-426c-bbfc-d2927bc7e57f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14] added
Dec 05 13:41:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5973793-b999-4fd9-99b6-21a4b482e8de]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e2abb-39ac-4fb1-9348-85eb72cfa08c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxUsjGZl {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxUsjGZl" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a351b-988d-4e86-b98c-76b67ee875dd]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KxUsjGZl'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da9c9a-c4f8-411a-a8eb-6fa4f19b11ff]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d99158-06f9-47b7-be73-77da8afa13e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ab3a8-94d3-4f3e-adc1-2eb5776913a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260]
Dec 05 13:41:29 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 could not be found.
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[657e0eca-1284-40ab-94d3-95a306a6cff8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:29 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2b6e0-bc3d-47a0-b61f-5aa5709502bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0253431e-f789-420a-bf99-89b7069a331d]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:29 user nova-compute[75233]: INFO nova.compute.manager [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Detaching volume 11539e50-cb7c-4799-89f2-90dfd924b3fd
Dec 05 13:41:29 user nova-compute[75233]: INFO nova.virt.block_device [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Attempting to driver detach volume 11539e50-cb7c-4799-89f2-90dfd924b3fd from mountpoint /dev/sdc
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Attempting to detach device sdc from instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:30 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:30 user nova-compute[75233]:   <source dev="/dev/sdk"/>
Dec 05 13:41:30 user nova-compute[75233]:   <target dev="sdc" bus="scsi"/>
Dec 05 13:41:30 user nova-compute[75233]:   <serial>11539e50-cb7c-4799-89f2-90dfd924b3fd</serial>
Dec 05 13:41:30 user nova-compute[75233]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 05 13:41:30 user nova-compute[75233]: </disk>
Dec 05 13:41:30 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Successfully detached device sdc from instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 from the persistent domain config.
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:30 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:30 user nova-compute[75233]:   <source dev="/dev/sdk"/>
Dec 05 13:41:30 user nova-compute[75233]:   <target dev="sdc" bus="scsi"/>
Dec 05 13:41:30 user nova-compute[75233]:   <serial>11539e50-cb7c-4799-89f2-90dfd924b3fd</serial>
Dec 05 13:41:30 user nova-compute[75233]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 05 13:41:30 user nova-compute[75233]: </disk>
Dec 05 13:41:30 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxUsjGZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23039356166386238', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039356166386238', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.077s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.objects.instance [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'flavor' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e310dd79-f1a8-4465-9c6d-82af6757b429]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:41:30 user nova-compute[75233]: No targets found.
Dec 05 13:41:30 user nova-compute[75233]: iSNS:
Dec 05 13:41:30 user nova-compute[75233]: No targets found.
Dec 05 13:41:30 user nova-compute[75233]: STATIC:
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:41:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:30 user nova-compute[75233]: FIRMWARE:
Dec 05 13:41:30 user nova-compute[75233]: No targets found.
Dec 05 13:41:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:41:30 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:41:30 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:41:30 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:30 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:41:30 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:30 user nova-compute[75233]:   <serial>457f3110-a7a4-41c8-86c1-989890f0bd14</serial>
Dec 05 13:41:30 user nova-compute[75233]: </disk>
Dec 05 13:41:30 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df70a2a-6ab8-4ada-910d-21655b55ada5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc65f2-bb54-41b5-a78a-8d9d0ae358b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f5822f760>, {}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Disconnecting from: [] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== disconnect_volume: return (1169ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-changed-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Refreshing instance network info cache due to event network-changed-a07ae192-8145-45ac-be9f-a7242a978e5d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] Acquiring lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] Acquired lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:30 user nova-compute[75233]: DEBUG nova.network.neutron [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Refreshing network info cache for port a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No BDM found with device name hda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] No VIF found with MAC fa:16:3e:73:8c:03, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.network.neutron [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Updated VIF entry in instance network info cache for port a07ae192-8145-45ac-be9f-a7242a978e5d. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.network.neutron [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Updating instance_info_cache with network_info: [{"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a7675ff3-fd76-4b6f-82c1-86fc933d599a req-de1e57e8-79ca-4a4d-acc9-91ccfa1074bd service nova] Releasing lock "refresh_cache-885d9ddc-a084-472d-9422-5c93f549090d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Preparing to wait for external event volume-reimaged-6621e3db-b8d2-4e8b-b76c-e7af765972e1 {{(pid=75233) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'flavor' on Instance uuid 885d9ddc-a084-472d-9422-5c93f549090d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Ignoring supplied device name: /dev/vdb
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-daf9f733-fb5b-4cb1-989d-6db34c32d2f6 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.253s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:32 user nova-compute[75233]: ERROR nova.volume.cinder [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Update attachment failed for attachment d2240526-a736-470f-8c72-7b76029ec2d2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4876be8d-b559-4152-a86d-374dafcbcd3c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4876be8d-b559-4152-a86d-374dafcbcd3c)
Dec 05 13:41:32 user nova-compute[75233]: ERROR nova.volume.cinder [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Update attachment failed for attachment 11f70281-b239-425d-992c-37cc245d6e48. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a841903-35d0-4716-95b6-bbe786088b3b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8a841903-35d0-4716-95b6-bbe786088b3b)
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:32 user nova-compute[75233]: INFO nova.compute.manager [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Attaching volume ddb2d3e7-22da-4e2f-b83e-61b88be70d59 to /dev/vdb
Dec 05 13:41:32 user nova-compute[75233]: DEBUG os_brick.utils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e912d241-a213-4f73-abcb-7d6a8d1bd230]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2764c-308a-4f99-97e3-30d523cbcf3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd7d3cc-98a5-4a1e-a8ff-d5aa74d45ab7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220de19-9c74-4f95-8f33-570ff8f4c6b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:32 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae72198-f1e0-4217-8817-be85b4e4d711]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG os_brick.utils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:32 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Updating existing volume attachment record: 1ad04bfa-e70b-48bf-9325-8048e11b5d58 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:41:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.267s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRxUAwQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61b72e12-781d-472c-841d-59cacd38578f', 'attached_at': '', 'detached_at': '', 'volume_id': '94fe9715-449a-4166-af6f-5a00758633e7', 'serial': '94fe9715-449a-4166-af6f-5a00758633e7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '61b72e12-781d-472c-841d-59cacd38578f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'serial'} {{(pid=75233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRxUAwQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:43 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqTzsoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0b4420-7589-437a-87c1-3c344c9e2cb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:43 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[05642fdd-6a00-4843-ae18-cf04c68add4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7] added
Dec 05 13:41:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b900d83e-66dc-4780-872a-f7501d8ce03f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a33de9e-1df2-4f7b-813d-d5b3c91af05d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRxUAwQh {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRxUAwQh" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5cccba-ac23-4b5e-8b8a-36fcde89d980]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRxUAwQh'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6805cde-5559-48da-8d4b-9420817105bb]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: INFO nova.compute.manager [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Detaching volume 457f3110-a7a4-41c8-86c1-989890f0bd14
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd34e90-2d7a-45d4-a166-5b4913c9207c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: INFO nova.virt.block_device [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Attempting to driver detach volume 457f3110-a7a4-41c8-86c1-989890f0bd14 from mountpoint /dev/vdb
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Attempting to detach device vdb from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:43 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:43 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:41:43 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:43 user nova-compute[75233]:   <serial>457f3110-a7a4-41c8-86c1-989890f0bd14</serial>
Dec 05 13:41:43 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 13:41:43 user nova-compute[75233]: </disk>
Dec 05 13:41:43 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf634396-7319-4a02-aae1-2c0600350d79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260]
Dec 05 13:41:43 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully detached device vdb from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the persistent domain config.
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:43 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:43 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:41:43 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:43 user nova-compute[75233]:   <serial>457f3110-a7a4-41c8-86c1-989890f0bd14</serial>
Dec 05 13:41:43 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 13:41:43 user nova-compute[75233]: </disk>
Dec 05 13:41:43 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcf6751-439c-4e87-8c80-f394bbea8bab]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bf1619-8751-4460-89b3-448baca8eb35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6fef44-2506-41f1-85ac-be206cf9dea9]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRxUAwQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmnKOxBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '26136303536623565', 'path': '/dev/sdl'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136303536623565', 'path': '/dev/sdl'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.548s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:44 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:44 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:41:44 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=6943MB free_disk=25.21185302734375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lazy-loading 'flavor' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521a099-099c-4c86-90f2-6844ec659776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:44 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78682ced-3476-4528-9ecb-6b7fd9a239f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2] added
Dec 05 13:41:44 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a71008-83bc-4931-8461-e94f6af4dd61]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc21c5-b765-4661-a45d-424d353285f7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqTzsoy {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqTzsoy" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc4025-9071-478f-abc3-2fe60bdcfbf5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOqTzsoy'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f8cbd-5dd2-47e8-b88f-fe2db9dca107]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 63978594-a36a-47f8-a596-4e6c1b965e7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 61b72e12-781d-472c-841d-59cacd38578f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 82f774ff-049f-4504-9fd0-b526079a13d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 885d9ddc-a084-472d-9422-5c93f549090d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a1a6e098-df9b-4d80-b239-a5c3483b1e6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance edbd6067-bd46-4f66-a10d-a01e36efca03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 293626c1-0760-43ab-8a9b-ebf0a659fb8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0154ca1d-3624-477f-b066-341c08ec10fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:44 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8af73e-51fd-49f5-a41a-9fc09b9cc4ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260]
Dec 05 13:41:44 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:44 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc060d1d-43a7-4681-8ad7-89244db1193f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e38762-f1c8-4564-b0e2-ac6b265bafbc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:45 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] HCTL ('45', '-', '-', 0) found on session 15 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Scanning host 45 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host45/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host45/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a433a097-8770-4411-b0f1-fc9b66abfb0a]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Searching for a device in session 15 and hctl ['45', '*', '*', 0] yield: sdn {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Connected to sdn using {'target_iqn': 'iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqTzsoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 182452224 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:45 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63978594-a36a-47f8-a596-4e6c1b965e7c is timed out.
Dec 05 13:41:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Successfully detached device vdb from instance 63978594-a36a-47f8-a596-4e6c1b965e7c from the live domain config.
Dec 05 13:41:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGknDVqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:45 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] <== connect_volume: return (2963ms) {'type': 'block', 'scsi_wwn': '23561303538333937', 'path': '/dev/sdn'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561303538333937', 'path': '/dev/sdn'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.331s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:46 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:46 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lazy-loading 'flavor' on Instance uuid 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a1772-2693-4417-a5cc-b8d912a7fffb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:41:46 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff897eb-0ff4-4c4c-9f8b-7c4a6d0f1956]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59] added
Dec 05 13:41:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 339738624 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] attach device xml: <disk type="block" device="disk">
Dec 05 13:41:46 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:46 user nova-compute[75233]:   <source dev="/dev/sdn"/>
Dec 05 13:41:46 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:46 user nova-compute[75233]:   <serial>c203460b-2847-444f-b3b0-e9d0ace4d7f2</serial>
Dec 05 13:41:46 user nova-compute[75233]: </disk>
Dec 05 13:41:46 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98cefbc-62b3-468c-9515-421f49c5a3aa]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[44083791-28fb-4d5e-829e-ff5ac3b01166]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmnKOxBJ {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmnKOxBJ" returned: 0 in 0.034s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb95ab-02ee-473a-b69c-f98c665fb93c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmnKOxBJ'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5362ad-5050-4b35-b9d9-ebc5e3dbeb22]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f193e4-6c95-4d8c-b2dd-24dcf8f7b550]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da4342-558e-48bb-a019-3cffbb0eeb6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260]
Dec 05 13:41:46 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2df91f9-2c07-4237-aa1a-73d5f1d8a2a1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca68ed1e-521a-452f-9094-f98a11f47473]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] HCTL ('46', '-', '-', 0) found on session 16 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Scanning host 46 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host46/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host46/scan" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c9f91a-a879-499a-971f-b557f455a199]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching for a device in session 16 and hctl ['46', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] No VIF found with MAC fa:16:3e:9f:ae:88, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d2997cf8-89aa-4b7f-aa0e-c55dad3213db tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.477s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 627048448 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching for a device in session 16 and hctl ['46', '*', '*', 0] yield: sdo {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Connected to sdo using {'target_iqn': 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmnKOxBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.565s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== connect_volume: return (3896ms) {'type': 'block', 'scsi_wwn': '23735336133353636', 'path': '/dev/sdo'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735336133353636', 'path': '/dev/sdo'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.697s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'flavor' on Instance uuid 885d9ddc-a084-472d-9422-5c93f549090d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ace6da-de91-428b-a880-0036b2347587]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:41:47 user nova-compute[75233]: No targets found.
Dec 05 13:41:47 user nova-compute[75233]: iSNS:
Dec 05 13:41:47 user nova-compute[75233]: No targets found.
Dec 05 13:41:47 user nova-compute[75233]: STATIC:
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:41:47 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:47 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:47 user nova-compute[75233]: FIRMWARE:
Dec 05 13:41:47 user nova-compute[75233]: No targets found.
Dec 05 13:41:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:41:47 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:41:47 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 801112064 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:41:47 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:47 user nova-compute[75233]:   <source dev="/dev/sdo"/>
Dec 05 13:41:47 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:47 user nova-compute[75233]:   <serial>ddb2d3e7-22da-4e2f-b83e-61b88be70d59</serial>
Dec 05 13:41:47 user nova-compute[75233]: </disk>
Dec 05 13:41:47 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b26d4-777c-4454-9939-4c09b8be533c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4fbb8e-42e2-4e8e-bda7-f7c13bdfcb6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 (non-flash)
Dec 05 13:41:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4'): ({'sdi'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Removing single pathed devices sdi {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe8d08c-f134-48ce-b2b0-57a6d00653df]: (4, ('path checker states:\nup                  14\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a4efa-f1a1-438d-ad3c-ad07782cab01]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Flushing IO for device /dev/sdi {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92684fa4-4c69-4e0b-b571-16a27b926e94]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1688b-2c12-4a28-8328-4ed05232abeb]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] SCSI volumes sdi have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[26630d42-7b70-42fc-8578-cd4aa65b7237]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] volume_snapshot_create: create_info: {'snapshot_id': '868526f9-2075-4076-ac9f-2bdfd57bf86f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75233) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] snap xml: <domainsnapshot>
Dec 05 13:41:48 user nova-compute[75233]:   <disks>
Dec 05 13:41:48 user nova-compute[75233]:     <disk name="/dev/sdn" snapshot="external" type="file">
Dec 05 13:41:48 user nova-compute[75233]:       <source file="/dev/new_file"/>
Dec 05 13:41:48 user nova-compute[75233]:     </disk>
Dec 05 13:41:48 user nova-compute[75233]:     <disk name="vda" snapshot="no"/>
Dec 05 13:41:48 user nova-compute[75233]:   </disks>
Dec 05 13:41:48 user nova-compute[75233]: </domainsnapshot>
Dec 05 13:41:48 user nova-compute[75233]:  {{(pid=75233) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] Lazy-loading 'system_metadata' on Instance uuid 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac4bc44-84f7-478d-9396-6ec83cbf925c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260]
Dec 05 13:41:48 user nova-compute[75233]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:48 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd13f867-4a77-4023-a341-248c7a1000d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d78e8f-e9e3-4986-9903-23010e2fa47a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] <== disconnect_volume: return (2179ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No VIF found with MAC fa:16:3e:79:77:80, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2c517993-e3dc-46c6-8696-552a8ece7e96 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] volume_snapshot_delete: delete_info: {'volume_id': 'c203460b-2847-444f-b3b0-e9d0ace4d7f2'} {{(pid=75233) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [None req-2c517993-e3dc-46c6-8696-552a8ece7e96 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     if delete_info['type'] != 'qcow2':
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] KeyError: 'type'
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] 
Dec 05 13:41:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     rv = execute(f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     six.reraise(c, e, tb)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     raise value
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     rv = meth(*args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     self._volume_snapshot_create(context, instance, guest,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     rv = execute(f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     six.reraise(c, e, tb)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     raise value
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     rv = meth(*args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] 
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [None req-2c517993-e3dc-46c6-8696-552a8ece7e96 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-eb82edb7-569c-45ee-a564-502c5cc92723)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server [None req-2c517993-e3dc-46c6-8696-552a8ece7e96 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] Exception during message handling: KeyError: 'type'
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 868526f9-2075-4076-ac9f-2bdfd57bf86f could not be found.
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise value
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 868526f9-2075-4076-ac9f-2bdfd57bf86f could not be found. (HTTP 404) (Request-ID: req-c6bc3411-9e50-4677-a93f-dd1ba5447539)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 868526f9-2075-4076-ac9f-2bdfd57bf86f could not be found.
Dec 05 13:41:48 user nova-compute[75233]: ERROR nova.virt.libvirt.driver 
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server [None req-fbd12575-baea-4e38-9ed5-f9709ce619d2 tempest-VolumesAssistedSnapshotsTest-1549745957 tempest-VolumesAssistedSnapshotsTest-1549745957-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     raise value
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 13:41:48 user nova-compute[75233]: ERROR oslo_messaging.rpc.server 
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a318-1c30-4ab5-a641-0616a11a9efc tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.947s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:48 user nova-compute[75233]: INFO nova.compute.manager [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Detaching volume c203460b-2847-444f-b3b0-e9d0ace4d7f2
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:41:48 user nova-compute[75233]: INFO nova.virt.block_device [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Attempting to driver detach volume c203460b-2847-444f-b3b0-e9d0ace4d7f2 from mountpoint /dev/vdb
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Attempting to detach device vdb from instance 82f774ff-049f-4504-9fd0-b526079a13d5 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:48 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:48 user nova-compute[75233]:   <source dev="/dev/sdn"/>
Dec 05 13:41:48 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:48 user nova-compute[75233]:   <serial>c203460b-2847-444f-b3b0-e9d0ace4d7f2</serial>
Dec 05 13:41:48 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:41:48 user nova-compute[75233]: </disk>
Dec 05 13:41:48 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Successfully detached device vdb from instance 82f774ff-049f-4504-9fd0-b526079a13d5 from the persistent domain config.
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82f774ff-049f-4504-9fd0-b526079a13d5 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] detach device xml: <disk type="block" device="disk">
Dec 05 13:41:48 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:41:48 user nova-compute[75233]:   <source dev="/dev/sdn"/>
Dec 05 13:41:48 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:41:48 user nova-compute[75233]:   <serial>c203460b-2847-444f-b3b0-e9d0ace4d7f2</serial>
Dec 05 13:41:48 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:41:48 user nova-compute[75233]: </disk>
Dec 05 13:41:48 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:48 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c349e5-9d9e-411b-93ae-242362369561]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:41:48 user nova-compute[75233]: No targets found.
Dec 05 13:41:48 user nova-compute[75233]: iSNS:
Dec 05 13:41:48 user nova-compute[75233]: No targets found.
Dec 05 13:41:48 user nova-compute[75233]: STATIC:
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:41:48 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:48 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:48 user nova-compute[75233]: FIRMWARE:
Dec 05 13:41:48 user nova-compute[75233]: No targets found.
Dec 05 13:41:48 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:41:48 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:41:48 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:41:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f55fa2c-04f0-4388-98b4-b3f1a579376f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d6b013-84fa-4c96-9073-c0ca6b0feed3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:49 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342'): ({'sdj'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Removing single pathed devices sdj {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[922508cb-55f3-44cc-86ad-8b5dc0753d0a]: (4, ('path checker states:\nup                  13\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff299947-e9d3-46a8-91b0-77706f4797de]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Flushing IO for device /dev/sdj {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[050328b8-b0d7-4d77-9b3b-22605d6896d1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1382da-35d8-41e9-a9e5-ed6f160ec4f3]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] SCSI volumes sdj have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ed960f-80c6-401e-b92d-64acc23f49c0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --logout" returned: 0 in 0.323s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9795fd2-05ae-4570-8ff1-7b1cda0eb6c9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]
Dec 05 13:41:49 user nova-compute[75233]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e83c31-8d34-4918-ab84-8b00b800b892]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.635s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] <== disconnect_volume: return (636ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG nova.objects.instance [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'flavor' on Instance uuid 63978594-a36a-47f8-a596-4e6c1b965e7c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2964a66e-7bb5-4780-9729-80debd4d10cf tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.301s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRxUAwQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '61b72e12-781d-472c-841d-59cacd38578f', 'attached_at': '', 'detached_at': '', 'volume_id': '94fe9715-449a-4166-af6f-5a00758633e7', 'serial'} {{(pid=75233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 05 13:41:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] swap_volume: removing Cinder connection for volume a78ebbc6-fd4d-45b7-a525-c79b826f4342 {{(pid=75233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 05 13:41:50 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 is timed out.
Dec 05 13:41:50 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Successfully detached device sdc from instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 from the live domain config.
Dec 05 13:41:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMjFEHoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:50 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb32f4-b22f-4daa-b661-d80ddbd6bec5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:41:50 user nova-compute[75233]: No targets found.
Dec 05 13:41:50 user nova-compute[75233]: iSNS:
Dec 05 13:41:50 user nova-compute[75233]: No targets found.
Dec 05 13:41:50 user nova-compute[75233]: STATIC:
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:41:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:41:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:41:50 user nova-compute[75233]: FIRMWARE:
Dec 05 13:41:50 user nova-compute[75233]: No targets found.
Dec 05 13:41:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:41:50 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:41:50 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1afda2-1f4b-4f5e-a94a-929ad54af02c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ba6d8-1fd9-4186-9195-27b9d24dbeda]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:41:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:41:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34746cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd'): ({'sdk'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Removing single pathed devices sdk {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98207bf-f3f3-45e7-9959-cd4fdc933e27]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b12b3d-dd95-43dd-a73f-635cb03f4522]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Flushing IO for device /dev/sdk {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25798a64-1f58-4bd6-a43a-88faa45e24ba]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f232c8c-879f-499e-9068-66bcb09c60bf]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] SCSI volumes sdk have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7abd8aa-f752-4297-9e26-e2b1f7f55cba]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb020aef-b8bd-4a6e-bc25-ac38cfc687e5]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260]
Dec 05 13:41:50 user nova-compute[75233]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd, portal: 172.16.0.220,3260] successful.
Dec 05 13:41:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11539e50-cb7c-4799-89f2-90dfd924b3fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a42dc0f-15f8-4f80-b8f0-c79272fd91c9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] <== disconnect_volume: return (399ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:41:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] swap_volume: Updating volume a78ebbc6-fd4d-45b7-a525-c79b826f4342 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MRxUAwQh", "auth_password": "6srigmQ93z5Ck8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "94fe9715-449a-4166-af6f-5a00758633e7"}, "status": "reserved", "instance": "61b72e12-781d-472c-841d-59cacd38578f", "attached_at": "", "detached_at": "", "volume_id": "94fe9715-449a-4166-af6f-5a00758633e7", "serial": "94fe9715-449a-4166-af6f-5a00758633e7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '94fe9715-449a-4166-af6f-5a00758633e7', 'no_device': None, 'attachment_id': '11f70281-b239-425d-992c-37cc245d6e48'} {{(pid=75233) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 05 13:41:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0329f811-0954-49c6-a6fd-ca331ce2f11f tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 24.684s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lazy-loading 'flavor' on Instance uuid e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG os_brick.utils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d02ca-878d-46fd-9053-70222bd85bae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5ac5a99e-8b3e-469d-b66e-82df619ed3ef tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.521s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93947448-3a2b-45a9-a64e-66d031393cfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[633a8efd-198c-4493-802d-c79e2a0251f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6023d3f1-b2a7-4e30-8884-ab721c17cc7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:52 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2edc8-1b34-4ad6-af13-ce86f0138e04]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:52 user nova-compute[75233]: DEBUG os_brick.utils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:52 user nova-compute[75233]: INFO nova.compute.manager [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Swapping volume 94fe9715-449a-4166-af6f-5a00758633e7 for a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:41:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 req-ffa06b65-95ad-496f-a6e3-487609c92e0c service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event volume-reimaged-6621e3db-b8d2-4e8b-b76c-e7af765972e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 req-ffa06b65-95ad-496f-a6e3-487609c92e0c service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 req-ffa06b65-95ad-496f-a6e3-487609c92e0c service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 req-ffa06b65-95ad-496f-a6e3-487609c92e0c service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 req-ffa06b65-95ad-496f-a6e3-487609c92e0c service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Processing event volume-reimaged-6621e3db-b8d2-4e8b-b76c-e7af765972e1 {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:41:53 user nova-compute[75233]: INFO nova.virt.block_device [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Booting with volume 6621e3db-b8d2-4e8b-b76c-e7af765972e1 at /dev/vda
Dec 05 13:41:53 user nova-compute[75233]: DEBUG os_brick.utils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f284e-916c-4145-99cf-6f20ff831cbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a03fe-9f39-4579-a527-6c345c40e58d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:53 user nova-compute[75233]: INFO nova.compute.manager [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Terminating instance
Dec 05 13:41:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f57ab-edda-486f-acd0-29fff8c78ee4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7943e106-dc05-445c-96cf-c51afb7902be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:41:53 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:41:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[10357a05-54ce-4e05-959f-313628409450]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG os_brick.utils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updating existing volume attachment record: 0d920127-dadf-480a-90c0-c09bc6bfb150 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-59709011-8960-417c-9955-732d42e99334 req-6d3a3704-e6e9-43ae-b5ca-d11e9750f0d6 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-vif-unplugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-59709011-8960-417c-9955-732d42e99334 req-6d3a3704-e6e9-43ae-b5ca-d11e9750f0d6 service nova] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-59709011-8960-417c-9955-732d42e99334 req-6d3a3704-e6e9-43ae-b5ca-d11e9750f0d6 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-59709011-8960-417c-9955-732d42e99334 req-6d3a3704-e6e9-43ae-b5ca-d11e9750f0d6 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-59709011-8960-417c-9955-732d42e99334 req-6d3a3704-e6e9-43ae-b5ca-d11e9750f0d6 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] No waiting events found dispatching network-vif-unplugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-59709011-8960-417c-9955-732d42e99334 req-6d3a3704-e6e9-43ae-b5ca-d11e9750f0d6 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-vif-unplugged-fd294db6-58bd-49b8-85bf-560b9253421c for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Instance destroyed successfully.
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lazy-loading 'resources' on Instance uuid e82c73ba-0a1a-42e2-8d47-9e4721fe57b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1445738985',display_name='tempest-AttachSCSIVolumeTestJSON-server-1445738985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1445738985',id=6,image_ref='1509f1f1-2653-46b6-9f44-feaae0e809c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrZrshm0tmXP/xbjDIEwk86wnXlVY9iAIFz+wUBTWznM9XdkMMs3aOt4C5HibeiG16IwP/sYnoLJnNieb4olMl6OfklrDrLDSURFS9NUKWEcDS2CXWT3j6/wfCpEUyiWw==',key_name='tempest-keypair-1163673000',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8d4abdb8b54f36bc6add14efac05d3',ramdisk_id='',reservation_id='r-tyk0sr5x',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1509f1f1-2653-46b6-9f44-feaae0e809c9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1030047827',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1030047827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56f7dddea94e4a2da0fcc5b103391fcd',uuid=e82c73ba-0a1a-42e2-8d47-9e4721fe57b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Converting VIF {"id": "fd294db6-58bd-49b8-85bf-560b9253421c", "address": "fa:16:3e:15:00:5d", "network": {"id": "ad78d542-f23d-4991-a4e8-cbe69493cb21", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-475059137-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8d4abdb8b54f36bc6add14efac05d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd294db6-58", "ovs_interfaceid": "fd294db6-58bd-49b8-85bf-560b9253421c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG os_vif [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd294db6-58, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e7fde71-04b9-4b37-a019-c27529e27da8) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:54 user nova-compute[75233]: INFO os_vif [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:00:5d,bridge_name='br-int',has_traffic_filtering=True,id=fd294db6-58bd-49b8-85bf-560b9253421c,network=Network(ad78d542-f23d-4991-a4e8-cbe69493cb21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd294db6-58')
Dec 05 13:41:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Deleting instance files /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5_del
Dec 05 13:41:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Deletion of /opt/stack/data/nova/instances/e82c73ba-0a1a-42e2-8d47-9e4721fe57b5_del complete
Dec 05 13:41:54 user nova-compute[75233]: INFO nova.compute.manager [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Took 1.41 seconds to destroy the instance on the hypervisor.
Dec 05 13:41:54 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:41:54 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:55 user nova-compute[75233]: INFO nova.compute.manager [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Terminating instance
Dec 05 13:41:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-ee029ecc-32ae-415c-a03e-6cc0f77fc67e req-4b59d596-0604-4c0f-b3d2-d85ce6826c2f service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-vif-unplugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ee029ecc-32ae-415c-a03e-6cc0f77fc67e req-4b59d596-0604-4c0f-b3d2-d85ce6826c2f service nova] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ee029ecc-32ae-415c-a03e-6cc0f77fc67e req-4b59d596-0604-4c0f-b3d2-d85ce6826c2f service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ee029ecc-32ae-415c-a03e-6cc0f77fc67e req-4b59d596-0604-4c0f-b3d2-d85ce6826c2f service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-ee029ecc-32ae-415c-a03e-6cc0f77fc67e req-4b59d596-0604-4c0f-b3d2-d85ce6826c2f service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] No waiting events found dispatching network-vif-unplugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-ee029ecc-32ae-415c-a03e-6cc0f77fc67e req-4b59d596-0604-4c0f-b3d2-d85ce6826c2f service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-vif-unplugged-04447cb6-67cc-447d-8966-59ef344b42da for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-51e72b6d-2be1-4da7-9f8e-d3c4ab24d164 req-c607fde0-b86c-4ce7-becb-feb0f519c5b1 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-51e72b6d-2be1-4da7-9f8e-d3c4ab24d164 req-c607fde0-b86c-4ce7-becb-feb0f519c5b1 service nova] Acquiring lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-51e72b6d-2be1-4da7-9f8e-d3c4ab24d164 req-c607fde0-b86c-4ce7-becb-feb0f519c5b1 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-51e72b6d-2be1-4da7-9f8e-d3c4ab24d164 req-c607fde0-b86c-4ce7-becb-feb0f519c5b1 service nova] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-51e72b6d-2be1-4da7-9f8e-d3c4ab24d164 req-c607fde0-b86c-4ce7-becb-feb0f519c5b1 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] No waiting events found dispatching network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:56 user nova-compute[75233]: WARNING nova.compute.manager [req-51e72b6d-2be1-4da7-9f8e-d3c4ab24d164 req-c607fde0-b86c-4ce7-becb-feb0f519c5b1 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received unexpected event network-vif-plugged-fd294db6-58bd-49b8-85bf-560b9253421c for instance with vm_state active and task_state deleting.
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Took 1.48 seconds to deallocate network for instance.
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Instance destroyed successfully.
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lazy-loading 'resources' on Instance uuid 293626c1-0760-43ab-8a9b-ebf0a659fb8b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-268008852',display_name='tempest-VolumesNegativeTest-instance-268008852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-268008852',id=13,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e37cdc2a01234cfcb96bf24cb8c0681c',ramdisk_id='',reservation_id='r-4345btzx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2105369082',owner_user_name='tempest-VolumesNegativeTest-2105369082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:13Z,user_data=None,user_id='010444fd3eb7443183b91242dea6162f',uuid=293626c1-0760-43ab-8a9b-ebf0a659fb8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Converting VIF {"id": "04447cb6-67cc-447d-8966-59ef344b42da", "address": "fa:16:3e:8c:e1:67", "network": {"id": "2c315c24-2661-49c5-b242-3b174395b452", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ef190e0b7394693855bd829530ab7a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04447cb6-67", "ovs_interfaceid": "04447cb6-67cc-447d-8966-59ef344b42da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG os_vif [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04447cb6-67, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44038765-5b87-4d64-a5f3-e5e9e404a5cf) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:41:56 user nova-compute[75233]: INFO os_vif [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e1:67,bridge_name='br-int',has_traffic_filtering=True,id=04447cb6-67cc-447d-8966-59ef344b42da,network=Network(2c315c24-2661-49c5-b242-3b174395b452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04447cb6-67')
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Deleting instance files /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b_del
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Deletion of /opt/stack/data/nova/instances/293626c1-0760-43ab-8a9b-ebf0a659fb8b_del complete
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.compute.manager [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Took 0.74 seconds to destroy the instance on the hypervisor.
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Took 0.44 seconds to deallocate network for instance.
Dec 05 13:41:56 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Deleted allocations for instance e82c73ba-0a1a-42e2-8d47-9e4721fe57b5
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e862633f-e4aa-410a-bea4-9f16e57b18f0 tempest-AttachSCSIVolumeTestJSON-1030047827 tempest-AttachSCSIVolumeTestJSON-1030047827-project-member] Lock "e82c73ba-0a1a-42e2-8d47-9e4721fe57b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.588s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:57 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Deleted allocations for instance 293626c1-0760-43ab-8a9b-ebf0a659fb8b
Dec 05 13:41:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4cc3e85-9f33-40ff-9380-65c08686c34a tempest-VolumesNegativeTest-2105369082 tempest-VolumesNegativeTest-2105369082-project-member] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-f9e1e5c4-f705-4027-aa11-2858bec94846 req-39f0ffdd-6f06-4799-89a7-c7f3d3779525 service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f9e1e5c4-f705-4027-aa11-2858bec94846 req-39f0ffdd-6f06-4799-89a7-c7f3d3779525 service nova] Acquiring lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f9e1e5c4-f705-4027-aa11-2858bec94846 req-39f0ffdd-6f06-4799-89a7-c7f3d3779525 service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f9e1e5c4-f705-4027-aa11-2858bec94846 req-39f0ffdd-6f06-4799-89a7-c7f3d3779525 service nova] Lock "293626c1-0760-43ab-8a9b-ebf0a659fb8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:41:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-f9e1e5c4-f705-4027-aa11-2858bec94846 req-39f0ffdd-6f06-4799-89a7-c7f3d3779525 service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] No waiting events found dispatching network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:41:57 user nova-compute[75233]: WARNING nova.compute.manager [req-f9e1e5c4-f705-4027-aa11-2858bec94846 req-39f0ffdd-6f06-4799-89a7-c7f3d3779525 service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received unexpected event network-vif-plugged-04447cb6-67cc-447d-8966-59ef344b42da for instance with vm_state deleted and task_state None.
Dec 05 13:41:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-174742b5-4591-40f5-a63a-9a3c2faaa521 req-c1eb19b4-ff39-4a0b-a092-ecfeff0c2a31 service nova] [instance: e82c73ba-0a1a-42e2-8d47-9e4721fe57b5] Received event network-vif-deleted-fd294db6-58bd-49b8-85bf-560b9253421c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:41:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-174742b5-4591-40f5-a63a-9a3c2faaa521 req-c1eb19b4-ff39-4a0b-a092-ecfeff0c2a31 service nova] [instance: 293626c1-0760-43ab-8a9b-ebf0a659fb8b] Received event network-vif-deleted-04447cb6-67cc-447d-8966-59ef344b42da {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61b72e12-781d-472c-841d-59cacd38578f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'serial': 'a78ebbc6-fd4d-45b7-a525-c79b826f4342'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRxUAwQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '94fe9715-449a-4166-af6f-5a00758633e7'}, 'status': 'reserved', 'instance': '61b72e12-781d-472c-841d-59cacd38578f', 'attached_at': '', 'detached_at': '', 'volume_id': '94fe9715-449a-4166-af6f-5a00758633e7', 'serial'} {{(pid=75233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:03 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:03 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:03 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e443d4-9b75-429c-9647-73ee38009188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:42:03 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb5cdca-ac9b-488e-8850-05a573cfdb64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342] added
Dec 05 13:42:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71f7bf-d44c-4e37-8abd-0f327d92366d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c256824-034e-4793-aaca-f4f3a71b8136]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFSNsOqU {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFSNsOqU" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c8ffef-c953-4858-81f0-eeeae63ea9a7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFSNsOqU'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[180bda25-3612-45fa-9278-5b9e3517a6e1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcba206c-c150-49cc-a865-b277be432f52]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d26d133-f8cd-4083-9b3e-17570e63f852]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]
Dec 05 13:42:03 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaf0363-1294-43f6-b3a4-fb09a3b81179]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fee74-dc8f-421f-8c01-05a1c1cf9736]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:03 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] HCTL ('40', '-', '-', 0) found on session 17 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e25c2-34e5-41e7-b72b-2b8b0326cd7f]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Searching for a device in session 17 and hctl ['40', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:03 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c is timed out.
Dec 05 13:42:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully detached device vdb from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the live domain config.
Dec 05 13:42:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxUsjGZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:03 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:42:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Creating image(s)
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Start _get_guest_xml network_info=[{"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5', 'attached_at': '', 'detached_at': '', 'volume_id': '6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'serial': '6621e3db-b8d2-4e8b-b76c-e7af765972e1'}, 'delete_on_termination': True, 'attachment_id': '0d920127-dadf-480a-90c0-c09bc6bfb150', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:42:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 13:42:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Searching for a device in session 17 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23933656633323938', 'path': '/dev/sdi'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933656633323938', 'path': '/dev/sdi'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.939s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lazy-loading 'flavor' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:04 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa62c3-4a6f-4621-8f1b-90cfe53aed15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:04 user nova-compute[75233]: No targets found.
Dec 05 13:42:04 user nova-compute[75233]: iSNS:
Dec 05 13:42:04 user nova-compute[75233]: No targets found.
Dec 05 13:42:04 user nova-compute[75233]: STATIC:
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:42:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:04 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:04 user nova-compute[75233]: No targets found.
Dec 05 13:42:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:04 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:04 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c6a9a-f0b2-4b17-af39-9e7f4d5c3ef6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac533314-980f-4c80-8976-9a3df87c418d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f600e5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7beeac-0fb0-4cce-a5e9-84a2e3154555]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d0974-51c0-4fc2-9af7-67e39b8be92e]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b789cc40-50f5-4fa5-88f9-fe891fd4a05c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc9055e-aec9-4735-9a43-fd25310c3070]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f88c8-bf13-4f64-ac0d-3a2248221c20]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c62872-21dc-4aef-a084-d3967c8d5694]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260]
Dec 05 13:42:05 user nova-compute[75233]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:457f3110-a7a4-41c8-86c1-989890f0bd14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc13d8-a23e-4516-bf2b-b637616cb3fc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] <== disconnect_volume: return (1356ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.370s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:05 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:05 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a7bc8f-5a51-4905-995c-ee6ef7e9fd8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:42:05 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253b289-943b-49c7-a259-9acb427d3f88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1] added
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[39842954-bc9c-436b-bb57-ee1f8c875475]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe81e3f-0218-438c-a44c-e262f51adfe5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToLYGdhj {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToLYGdhj" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94961a4c-b32b-4c18-9299-22c48bb5e48a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ToLYGdhj'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ace97-7f8e-4040-8f0c-015c546b32e1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2824efae-1597-4bae-8356-5aa2e5e08e1f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5ed580-5280-4914-97ab-44b31205102f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]
Dec 05 13:42:05 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c336c52d-e55a-4cf0-98e2-d17eb45ab835]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b53f1e-27aa-463c-b8bb-c07df325d54f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:05 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:05 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6f6a89-4e42-487b-8627-effca00a0a5b]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:42:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 227540992 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.objects.instance [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'flavor' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== connect_volume: return (1854ms) {'type': 'block', 'scsi_wwn': '23135316337663434', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135316337663434', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1541058515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-198484875',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBjirTdgwguXf8pJpDGH38q17eBDHncaQ+iB6D3hlb+s4hJpshKYtlQvlsbwGbpt6MhXarCfCtSdWaWLFu4ehJfgNc1TbGggoGeDFMM241T3aOm8pSjB5QSszJrkc/AA==',key_name='tempest-keypair-791952996',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e4d0d8d26d14eebac1d61089119a062',ramdisk_id='',reservation_id='r-5tvy1x7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1073184207',owner_user_name='tempest-ServerActionsV293TestJSON-1073184207-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158e2993042b45339f98fc5fff0aaf2c',uuid=0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converting VIF {"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:42:06 user nova-compute[75233]:   <uuid>0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5</uuid>
Dec 05 13:42:06 user nova-compute[75233]:   <name>instance-00000009</name>
Dec 05 13:42:06 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:42:06 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:42:06 user nova-compute[75233]:   <metadata>
Dec 05 13:42:06 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:06 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:42:06 user nova-compute[75233]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1541058515</nova:name>
Dec 05 13:42:06 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:42:04</nova:creationTime>
Dec 05 13:42:06 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:42:06 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:06 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:42:06 user nova-compute[75233]:       <nova:owner>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:user uuid="158e2993042b45339f98fc5fff0aaf2c">tempest-ServerActionsV293TestJSON-1073184207-project-member</nova:user>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:project uuid="8e4d0d8d26d14eebac1d61089119a062">tempest-ServerActionsV293TestJSON-1073184207</nova:project>
Dec 05 13:42:06 user nova-compute[75233]:       </nova:owner>
Dec 05 13:42:06 user nova-compute[75233]:       <nova:ports>
Dec 05 13:42:06 user nova-compute[75233]:         <nova:port uuid="2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c">
Dec 05 13:42:06 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 13:42:06 user nova-compute[75233]:         </nova:port>
Dec 05 13:42:06 user nova-compute[75233]:       </nova:ports>
Dec 05 13:42:06 user nova-compute[75233]:     </nova:instance>
Dec 05 13:42:06 user nova-compute[75233]:   </metadata>
Dec 05 13:42:06 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:42:06 user nova-compute[75233]:     <system>
Dec 05 13:42:06 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:42:06 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:42:06 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:42:06 user nova-compute[75233]:       <entry name="serial">0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5</entry>
Dec 05 13:42:06 user nova-compute[75233]:       <entry name="uuid">0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5</entry>
Dec 05 13:42:06 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:42:06 user nova-compute[75233]:     </system>
Dec 05 13:42:06 user nova-compute[75233]:   </sysinfo>
Dec 05 13:42:06 user nova-compute[75233]:   <os>
Dec 05 13:42:06 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:42:06 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:42:06 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:42:06 user nova-compute[75233]:   </os>
Dec 05 13:42:06 user nova-compute[75233]:   <features>
Dec 05 13:42:06 user nova-compute[75233]:     <acpi/>
Dec 05 13:42:06 user nova-compute[75233]:     <apic/>
Dec 05 13:42:06 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:42:06 user nova-compute[75233]:   </features>
Dec 05 13:42:06 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:42:06 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:42:06 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:42:06 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:42:06 user nova-compute[75233]:   </clock>
Dec 05 13:42:06 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:42:06 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:42:06 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:42:06 user nova-compute[75233]:   </cpu>
Dec 05 13:42:06 user nova-compute[75233]:   <devices>
Dec 05 13:42:06 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:42:06 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:42:06 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 13:42:06 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:42:06 user nova-compute[75233]:       <serial>6621e3db-b8d2-4e8b-b76c-e7af765972e1</serial>
Dec 05 13:42:06 user nova-compute[75233]:     </disk>
Dec 05 13:42:06 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:42:06 user nova-compute[75233]:       <mac address="fa:16:3e:be:ca:d7"/>
Dec 05 13:42:06 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:42:06 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:42:06 user nova-compute[75233]:       <target dev="tap2a9a4a9a-4a"/>
Dec 05 13:42:06 user nova-compute[75233]:     </interface>
Dec 05 13:42:06 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:42:06 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5/console.log" append="off"/>
Dec 05 13:42:06 user nova-compute[75233]:     </serial>
Dec 05 13:42:06 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:42:06 user nova-compute[75233]:     <video>
Dec 05 13:42:06 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:42:06 user nova-compute[75233]:     </video>
Dec 05 13:42:06 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:42:06 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:42:06 user nova-compute[75233]:     </rng>
Dec 05 13:42:06 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:42:06 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:42:06 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:42:06 user nova-compute[75233]:     </memballoon>
Dec 05 13:42:06 user nova-compute[75233]:   </devices>
Dec 05 13:42:06 user nova-compute[75233]: </domain>
Dec 05 13:42:06 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1541058515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-198484875',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBjirTdgwguXf8pJpDGH38q17eBDHncaQ+iB6D3hlb+s4hJpshKYtlQvlsbwGbpt6MhXarCfCtSdWaWLFu4ehJfgNc1TbGggoGeDFMM241T3aOm8pSjB5QSszJrkc/AA==',key_name='tempest-keypair-791952996',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8e4d0d8d26d14eebac1d61089119a062',ramdisk_id='',reservation_id='r-5tvy1x7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1073184207',owner_user_name='tempest-ServerActionsV293TestJSON-1073184207-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158e2993042b45339f98fc5fff0aaf2c',uuid=0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converting VIF {"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG os_vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a701dee-3482-50ba-ba65-9fb9deb33f47', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a9a4a9a-4a, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a9a4a9a-4a, col_values=(('qos', UUID('e6770350-5e25-47d4-a032-f380cef706f1')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a9a4a9a-4a, col_values=(('external_ids', {'iface-id': '2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ca:d7', 'vm-uuid': '0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 325058560 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cfb4a3d2-18d5-42d1-a38b-8ba7792619ea tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.545s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:06 user nova-compute[75233]: INFO os_vif [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a')
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:42:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] No VIF found with MAC fa:16:3e:be:ca:d7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "interface-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-35026b32-2e65-4fe9-8e7f-0728c86624e1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "interface-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-35026b32-2e65-4fe9-8e7f-0728c86624e1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'flavor' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface> {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface> {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Attempting to detach device tap35026b32-2e from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] detach device xml: <interface type="ethernet">
Dec 05 13:42:07 user nova-compute[75233]:   <mac address="fa:16:3e:f1:c8:bf"/>
Dec 05 13:42:07 user nova-compute[75233]:   <model type="virtio"/>
Dec 05 13:42:07 user nova-compute[75233]:   <mtu size="1442"/>
Dec 05 13:42:07 user nova-compute[75233]:   <target dev="tap35026b32-2e"/>
Dec 05 13:42:07 user nova-compute[75233]: </interface>
Dec 05 13:42:07 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface> {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 05 13:42:07 user nova-compute[75233]:   <name>instance-00000007</name>
Dec 05 13:42:07 user nova-compute[75233]:   <uuid>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</uuid>
Dec 05 13:42:07 user nova-compute[75233]:   <metadata>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:07 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:42:07 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:42:07 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:41:16</nova:creationTime>
Dec 05 13:42:07 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:42:07 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:07 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:42:07 user nova-compute[75233]:   <nova:owner>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:42:07 user nova-compute[75233]:   </nova:owner>
Dec 05 13:42:07 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:07 user nova-compute[75233]:   <nova:ports>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:42:07 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:42:07 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:07 user nova-compute[75233]:     <nova:port uuid="35026b32-2e65-4fe9-8e7f-0728c86624e1">
Dec 05 13:42:07 user nova-compute[75233]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Dec 05 13:42:07 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:07 user nova-compute[75233]:   </nova:ports>
Dec 05 13:42:07 user nova-compute[75233]: </nova:instance>
Dec 05 13:42:07 user nova-compute[75233]:   </metadata>
Dec 05 13:42:07 user nova-compute[75233]:   <memory unit='KiB'>524288</memory>
Dec 05 13:42:07 user nova-compute[75233]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 13:42:07 user nova-compute[75233]:   <vcpu placement='static'>1</vcpu>
Dec 05 13:42:07 user nova-compute[75233]:   <resource>
Dec 05 13:42:07 user nova-compute[75233]:     <partition>/machine</partition>
Dec 05 13:42:07 user nova-compute[75233]:   </resource>
Dec 05 13:42:07 user nova-compute[75233]:   <sysinfo type='smbios'>
Dec 05 13:42:07 user nova-compute[75233]:     <system>
Dec 05 13:42:07 user nova-compute[75233]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 13:42:07 user nova-compute[75233]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 13:42:07 user nova-compute[75233]:       <entry name='version'>0.0.0</entry>
Dec 05 13:42:07 user nova-compute[75233]:       <entry name='serial'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:07 user nova-compute[75233]:       <entry name='uuid'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:07 user nova-compute[75233]:       <entry name='family'>Virtual Machine</entry>
Dec 05 13:42:07 user nova-compute[75233]:     </system>
Dec 05 13:42:07 user nova-compute[75233]:   </sysinfo>
Dec 05 13:42:07 user nova-compute[75233]:   <os>
Dec 05 13:42:07 user nova-compute[75233]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 13:42:07 user nova-compute[75233]:     <boot dev='hd'/>
Dec 05 13:42:07 user nova-compute[75233]:     <smbios mode='sysinfo'/>
Dec 05 13:42:07 user nova-compute[75233]:   </os>
Dec 05 13:42:07 user nova-compute[75233]:   <features>
Dec 05 13:42:07 user nova-compute[75233]:     <acpi/>
Dec 05 13:42:07 user nova-compute[75233]:     <apic/>
Dec 05 13:42:07 user nova-compute[75233]:     <vmcoreinfo state='on'/>
Dec 05 13:42:07 user nova-compute[75233]:   </features>
Dec 05 13:42:07 user nova-compute[75233]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 13:42:07 user nova-compute[75233]:     <model fallback='forbid'>Nehalem</model>
Dec 05 13:42:07 user nova-compute[75233]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 13:42:07 user nova-compute[75233]:     <feature policy='require' name='vme'/>
Dec 05 13:42:07 user nova-compute[75233]:     <feature policy='require' name='x2apic'/>
Dec 05 13:42:07 user nova-compute[75233]:     <feature policy='require' name='hypervisor'/>
Dec 05 13:42:07 user nova-compute[75233]:   </cpu>
Dec 05 13:42:07 user nova-compute[75233]:   <clock offset='utc'>
Dec 05 13:42:07 user nova-compute[75233]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 13:42:07 user nova-compute[75233]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 13:42:07 user nova-compute[75233]:     <timer name='hpet' present='no'/>
Dec 05 13:42:07 user nova-compute[75233]:   </clock>
Dec 05 13:42:07 user nova-compute[75233]:   <on_poweroff>destroy</on_poweroff>
Dec 05 13:42:07 user nova-compute[75233]:   <on_reboot>restart</on_reboot>
Dec 05 13:42:07 user nova-compute[75233]:   <on_crash>destroy</on_crash>
Dec 05 13:42:07 user nova-compute[75233]:   <devices>
Dec 05 13:42:07 user nova-compute[75233]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 13:42:07 user nova-compute[75233]:     <disk type='file' device='disk'>
Dec 05 13:42:07 user nova-compute[75233]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 13:42:07 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk' index='2'/>
Dec 05 13:42:07 user nova-compute[75233]:       <backingStore type='file' index='3'>
Dec 05 13:42:07 user nova-compute[75233]:         <format type='raw'/>
Dec 05 13:42:07 user nova-compute[75233]:         <source file='/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec'/>
Dec 05 13:42:07 user nova-compute[75233]:         <backingStore/>
Dec 05 13:42:07 user nova-compute[75233]:       </backingStore>
Dec 05 13:42:07 user nova-compute[75233]:       <target dev='vda' bus='virtio'/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='virtio-disk0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </disk>
Dec 05 13:42:07 user nova-compute[75233]:     <disk type='file' device='cdrom'>
Dec 05 13:42:07 user nova-compute[75233]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 13:42:07 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config' index='1'/>
Dec 05 13:42:07 user nova-compute[75233]:       <backingStore/>
Dec 05 13:42:07 user nova-compute[75233]:       <target dev='hda' bus='ide'/>
Dec 05 13:42:07 user nova-compute[75233]:       <readonly/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='ide0-0-0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </disk>
Dec 05 13:42:07 user nova-compute[75233]:     <controller type='usb' index='0' model='none'>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='usb'/>
Dec 05 13:42:07 user nova-compute[75233]:     </controller>
Dec 05 13:42:07 user nova-compute[75233]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='pci.0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </controller>
Dec 05 13:42:07 user nova-compute[75233]:     <controller type='ide' index='0'>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='ide'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 13:42:07 user nova-compute[75233]:     </controller>
Dec 05 13:42:07 user nova-compute[75233]:     <interface type='ethernet'>
Dec 05 13:42:07 user nova-compute[75233]:       <mac address='fa:16:3e:73:8c:03'/>
Dec 05 13:42:07 user nova-compute[75233]:       <target dev='tap1ad882c8-81'/>
Dec 05 13:42:07 user nova-compute[75233]:       <model type='virtio'/>
Dec 05 13:42:07 user nova-compute[75233]:       <mtu size='1442'/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='net0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </interface>
Dec 05 13:42:07 user nova-compute[75233]:     <interface type='ethernet'>
Dec 05 13:42:07 user nova-compute[75233]:       <mac address='fa:16:3e:f1:c8:bf'/>
Dec 05 13:42:07 user nova-compute[75233]:       <target dev='tap35026b32-2e'/>
Dec 05 13:42:07 user nova-compute[75233]:       <model type='virtio'/>
Dec 05 13:42:07 user nova-compute[75233]:       <mtu size='1442'/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='net1'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </interface>
Dec 05 13:42:07 user nova-compute[75233]:     <serial type='pty'>
Dec 05 13:42:07 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:07 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:07 user nova-compute[75233]:       <target type='isa-serial' port='0'>
Dec 05 13:42:07 user nova-compute[75233]:         <model name='isa-serial'/>
Dec 05 13:42:07 user nova-compute[75233]:       </target>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </serial>
Dec 05 13:42:07 user nova-compute[75233]:     <console type='pty' tty='/dev/pts/6'>
Dec 05 13:42:07 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:07 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:07 user nova-compute[75233]:       <target type='serial' port='0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </console>
Dec 05 13:42:07 user nova-compute[75233]:     <input type='mouse' bus='ps2'>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='input0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </input>
Dec 05 13:42:07 user nova-compute[75233]:     <input type='keyboard' bus='ps2'>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='input1'/>
Dec 05 13:42:07 user nova-compute[75233]:     </input>
Dec 05 13:42:07 user nova-compute[75233]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 05 13:42:07 user nova-compute[75233]:       <listen type='address' address='0.0.0.0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </graphics>
Dec 05 13:42:07 user nova-compute[75233]:     <audio id='1' type='none'/>
Dec 05 13:42:07 user nova-compute[75233]:     <video>
Dec 05 13:42:07 user nova-compute[75233]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='video0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </video>
Dec 05 13:42:07 user nova-compute[75233]:     <memballoon model='virtio'>
Dec 05 13:42:07 user nova-compute[75233]:       <stats period='10'/>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='balloon0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </memballoon>
Dec 05 13:42:07 user nova-compute[75233]:     <rng model='virtio'>
Dec 05 13:42:07 user nova-compute[75233]:       <backend model='random'>/dev/urandom</backend>
Dec 05 13:42:07 user nova-compute[75233]:       <alias name='rng0'/>
Dec 05 13:42:07 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 13:42:07 user nova-compute[75233]:     </rng>
Dec 05 13:42:07 user nova-compute[75233]:   </devices>
Dec 05 13:42:07 user nova-compute[75233]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 13:42:07 user nova-compute[75233]:     <label>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</label>
Dec 05 13:42:07 user nova-compute[75233]:     <imagelabel>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</imagelabel>
Dec 05 13:42:07 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:07 user nova-compute[75233]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 13:42:07 user nova-compute[75233]:     <label>+64055:+108</label>
Dec 05 13:42:07 user nova-compute[75233]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 13:42:07 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:07 user nova-compute[75233]: </domain>
Dec 05 13:42:07 user nova-compute[75233]:  {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 13:42:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully detached device tap35026b32-2e from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the persistent domain config.
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] (1/8): Attempting to detach device tap35026b32-2e with device alias net1 from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] detach device xml: <interface type="ethernet">
Dec 05 13:42:07 user nova-compute[75233]:   <mac address="fa:16:3e:f1:c8:bf"/>
Dec 05 13:42:07 user nova-compute[75233]:   <model type="virtio"/>
Dec 05 13:42:07 user nova-compute[75233]:   <mtu size="1442"/>
Dec 05 13:42:07 user nova-compute[75233]:   <target dev="tap35026b32-2e"/>
Dec 05 13:42:07 user nova-compute[75233]: </interface>
Dec 05 13:42:07 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 445644800 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Start waiting for the detach event from libvirt for device tap35026b32-2e with device alias net1 for instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 579862528 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-8c8e9ab3-cc14-42e3-a4f0-632b8b88c30e req-c0a1db3a-7e0b-4736-bb8f-5030df8e5733 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-unplugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c8e9ab3-cc14-42e3-a4f0-632b8b88c30e req-c0a1db3a-7e0b-4736-bb8f-5030df8e5733 service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c8e9ab3-cc14-42e3-a4f0-632b8b88c30e req-c0a1db3a-7e0b-4736-bb8f-5030df8e5733 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c8e9ab3-cc14-42e3-a4f0-632b8b88c30e req-c0a1db3a-7e0b-4736-bb8f-5030df8e5733 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-8c8e9ab3-cc14-42e3-a4f0-632b8b88c30e req-c0a1db3a-7e0b-4736-bb8f-5030df8e5733 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-unplugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:08 user nova-compute[75233]: WARNING nova.compute.manager [req-8c8e9ab3-cc14-42e3-a4f0-632b8b88c30e req-c0a1db3a-7e0b-4736-bb8f-5030df8e5733 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-unplugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 for instance with vm_state active and task_state None.
Dec 05 13:42:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 756023296 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc73a44f-aba8-4ca2-9e17-88427ec4d479 req-c86d05fe-09f9-480c-91fc-c423a114d658 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc73a44f-aba8-4ca2-9e17-88427ec4d479 req-c86d05fe-09f9-480c-91fc-c423a114d658 service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc73a44f-aba8-4ca2-9e17-88427ec4d479 req-c86d05fe-09f9-480c-91fc-c423a114d658 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc73a44f-aba8-4ca2-9e17-88427ec4d479 req-c86d05fe-09f9-480c-91fc-c423a114d658 service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc73a44f-aba8-4ca2-9e17-88427ec4d479 req-c86d05fe-09f9-480c-91fc-c423a114d658 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:08 user nova-compute[75233]: WARNING nova.compute.manager [req-dc73a44f-aba8-4ca2-9e17-88427ec4d479 req-c86d05fe-09f9-480c-91fc-c423a114d658 service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state active and task_state rebuild_spawning.
Dec 05 13:42:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 896532480 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82f774ff-049f-4504-9fd0-b526079a13d5 is timed out.
Dec 05 13:42:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Successfully detached device vdb from instance 82f774ff-049f-4504-9fd0-b526079a13d5 from the live domain config.
Dec 05 13:42:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqTzsoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdn'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:09 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.048s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332abc0-80c0-4519-bf7d-4150d59009f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:09 user nova-compute[75233]: No targets found.
Dec 05 13:42:09 user nova-compute[75233]: iSNS:
Dec 05 13:42:09 user nova-compute[75233]: No targets found.
Dec 05 13:42:09 user nova-compute[75233]: STATIC:
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:42:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:09 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:09 user nova-compute[75233]: No targets found.
Dec 05 13:42:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:09 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:09 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321221a-fc38-4e86-9f8c-3288da27f50e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 1046478848 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778a03f-4508-411b-86eb-e48c0286e854]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:09 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f58703490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2'): ({'sdn'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Removing single pathed devices sdn {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71a1f23-aa19-4446-b786-aab27a1da1e7]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdn" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0625fd-515c-4a70-838c-2c9a70e59969]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Flushing IO for device /dev/sdn {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdn" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bfb3c6-838c-4290-a302-9396eef17e66]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdn/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdn/device/delete" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d56d7-f370-4559-9ebc-09f3119c0703]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Checking to see if SCSI volumes sdn have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] SCSI volumes sdn have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c76bb7-469b-4381-bc01-6f27414313c2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd00b725-f3ee-4db4-be82-3827d02bbd7d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260]
Dec 05 13:42:09 user nova-compute[75233]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c203460b-2847-444f-b3b0-e9d0ace4d7f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f8a1c7-e4a9-4f2b-8712-3b028bff644c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] <== disconnect_volume: return (458ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRxUAwQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '94fe9715-449a-4166-af6f-5a00758633e7'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:10 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac97289-8fe8-4aae-a8ab-e2b89728f87d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:10 user nova-compute[75233]: No targets found.
Dec 05 13:42:10 user nova-compute[75233]: iSNS:
Dec 05 13:42:10 user nova-compute[75233]: No targets found.
Dec 05 13:42:10 user nova-compute[75233]: STATIC:
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:42:10 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:10 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:10 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:10 user nova-compute[75233]: No targets found.
Dec 05 13:42:10 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:10 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:10 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7e21f-cd80-48c3-ae47-552bfb6aa185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-d14a1db9-5342-4e83-bd98-0b566f99c5f1 req-8fdc53c4-ecd2-4021-a763-1436dda6830e service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d14a1db9-5342-4e83-bd98-0b566f99c5f1 req-8fdc53c4-ecd2-4021-a763-1436dda6830e service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d14a1db9-5342-4e83-bd98-0b566f99c5f1 req-8fdc53c4-ecd2-4021-a763-1436dda6830e service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d14a1db9-5342-4e83-bd98-0b566f99c5f1 req-8fdc53c4-ecd2-4021-a763-1436dda6830e service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-d14a1db9-5342-4e83-bd98-0b566f99c5f1 req-8fdc53c4-ecd2-4021-a763-1436dda6830e service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:10 user nova-compute[75233]: WARNING nova.compute.manager [req-d14a1db9-5342-4e83-bd98-0b566f99c5f1 req-8fdc53c4-ecd2-4021-a763-1436dda6830e service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-plugged-35026b32-2e65-4fe9-8e7f-0728c86624e1 for instance with vm_state active and task_state None.
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e74e881-a0fa-4ccd-bf76-1425e015a1d2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:10 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:10 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582cf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7'): ({'sdl'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Removing single pathed devices sdl {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e30363-e756-4240-8139-801ed5f36221]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf22c8-379d-4fb2-915c-0c78e2205caa]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Flushing IO for device /dev/sdl {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3891e7f5-52a6-419f-9877-22bc9fbef875]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.050s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf76a1e2-d756-4f31-976e-ef463966f4b2]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] SCSI volumes sdl have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea3ec7-3d2d-4c34-829d-60b3e3ce05ae]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516dc8a-23f2-4fe2-86e5-b54ecb8c5515]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260]
Dec 05 13:42:10 user nova-compute[75233]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:10 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fe9715-449a-4166-af6f-5a00758633e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34ecf64-7f88-4daf-82b6-c7689226da0e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] <== disconnect_volume: return (367ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '61b72e12-781d-472c-841d-59cacd38578f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'serial'} {{(pid=75233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] swap_volume: removing Cinder connection for volume 94fe9715-449a-4166-af6f-5a00758633e7 {{(pid=75233) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.objects.instance [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lazy-loading 'flavor' on Instance uuid 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-99ab1f40-950a-4d84-8972-15845a52c6ce tempest-VolumesAssistedSnapshotsTest-1316000502 tempest-VolumesAssistedSnapshotsTest-1316000502-project-admin] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.984s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-bb668bd2-6739-4b42-bb2d-21a6c2bd0829 req-3d5c7ba1-7765-4f8c-8995-4573e746ae0b service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb668bd2-6739-4b42-bb2d-21a6c2bd0829 req-3d5c7ba1-7765-4f8c-8995-4573e746ae0b service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb668bd2-6739-4b42-bb2d-21a6c2bd0829 req-3d5c7ba1-7765-4f8c-8995-4573e746ae0b service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bb668bd2-6739-4b42-bb2d-21a6c2bd0829 req-3d5c7ba1-7765-4f8c-8995-4573e746ae0b service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-bb668bd2-6739-4b42-bb2d-21a6c2bd0829 req-3d5c7ba1-7765-4f8c-8995-4573e746ae0b service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:10 user nova-compute[75233]: WARNING nova.compute.manager [req-bb668bd2-6739-4b42-bb2d-21a6c2bd0829 req-3d5c7ba1-7765-4f8c-8995-4573e746ae0b service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state active and task_state rebuild_spawning.
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:42:10 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance spawned successfully.
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75233) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c3da122a-f7cd-4dab-a754-074dcf5cf8e6 tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] [instance: 61b72e12-781d-472c-841d-59cacd38578f] swap_volume: Updating volume 94fe9715-449a-4166-af6f-5a00758633e7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aFSNsOqU", "auth_password": "79MfcNXQSVntaH", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "a78ebbc6-fd4d-45b7-a525-c79b826f4342"}, "status": "reserved", "instance": "61b72e12-781d-472c-841d-59cacd38578f", "attached_at": "", "detached_at": "", "volume_id": "a78ebbc6-fd4d-45b7-a525-c79b826f4342", "serial": "a78ebbc6-fd4d-45b7-a525-c79b826f4342"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'no_device': None, 'attachment_id': '45191707-3b5f-49ba-b7f7-10d55b84e718'} {{(pid=75233) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-542d67b3-6bdb-43b7-8402-7bf1d8c002a6 tempest-TestVolumeSwap-1943436816 tempest-TestVolumeSwap-1943436816-project-admin] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.978s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:12 user nova-compute[75233]: INFO nova.compute.manager [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Detaching volume a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:42:12 user nova-compute[75233]: INFO nova.virt.block_device [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Attempting to driver detach volume a78ebbc6-fd4d-45b7-a525-c79b826f4342 from mountpoint /dev/vdb
Dec 05 13:42:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Attempting to detach device vdb from instance 61b72e12-781d-472c-841d-59cacd38578f from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:42:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:42:12 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:42:12 user nova-compute[75233]:   <source dev="/dev/sdi"/>
Dec 05 13:42:12 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:42:12 user nova-compute[75233]:   <serial>a78ebbc6-fd4d-45b7-a525-c79b826f4342</serial>
Dec 05 13:42:12 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:42:12 user nova-compute[75233]: </disk>
Dec 05 13:42:12 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:42:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Successfully detached device vdb from instance 61b72e12-781d-472c-841d-59cacd38578f from the persistent domain config.
Dec 05 13:42:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61b72e12-781d-472c-841d-59cacd38578f from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:42:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:42:12 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:42:12 user nova-compute[75233]:   <source dev="/dev/sdi"/>
Dec 05 13:42:12 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:42:12 user nova-compute[75233]:   <serial>a78ebbc6-fd4d-45b7-a525-c79b826f4342</serial>
Dec 05 13:42:12 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:42:12 user nova-compute[75233]: </disk>
Dec 05 13:42:12 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:42:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:42:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "ea52330e-ed18-4c84-bd28-ca464c968ebf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:42:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:42:16 user nova-compute[75233]: INFO nova.compute.claims [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Claim successful on node user
Dec 05 13:42:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:42:17 user nova-compute[75233]: INFO nova.compute.manager [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Detaching volume ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:42:17 user nova-compute[75233]: INFO nova.virt.block_device [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Attempting to driver detach volume ddb2d3e7-22da-4e2f-b83e-61b88be70d59 from mountpoint /dev/vdb
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Attempting to detach device vdb from instance 885d9ddc-a084-472d-9422-5c93f549090d from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:42:17 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:42:17 user nova-compute[75233]:   <source dev="/dev/sdo"/>
Dec 05 13:42:17 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:42:17 user nova-compute[75233]:   <serial>ddb2d3e7-22da-4e2f-b83e-61b88be70d59</serial>
Dec 05 13:42:17 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:42:17 user nova-compute[75233]: </disk>
Dec 05 13:42:17 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:42:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully detached device vdb from instance 885d9ddc-a084-472d-9422-5c93f549090d from the persistent domain config.
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 885d9ddc-a084-472d-9422-5c93f549090d from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:42:17 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:42:17 user nova-compute[75233]:   <source dev="/dev/sdo"/>
Dec 05 13:42:17 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:42:17 user nova-compute[75233]:   <serial>ddb2d3e7-22da-4e2f-b83e-61b88be70d59</serial>
Dec 05 13:42:17 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:42:17 user nova-compute[75233]: </disk>
Dec 05 13:42:17 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:42:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.policy [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e28e6b2894c844ae864b0283b8824371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426a7cafbfd54c23a56c584b9107d871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:42:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Creating image(s)
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "/opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "/opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 885d9ddc-a084-472d-9422-5c93f549090d {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk 1073741824" returned: 0 in 0.055s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Successfully created port: e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Cannot resize image /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Ensure instance console log exists: /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Successfully updated port: e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "refresh_cache-ea52330e-ed18-4c84-bd28-ca464c968ebf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquired lock "refresh_cache-ea52330e-ed18-4c84-bd28-ca464c968ebf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Received event network-changed-e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Refreshing instance network info cache due to event network-changed-e298c0ed-2f03-4558-8a92-e6172b076cfe. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] Acquiring lock "refresh_cache-ea52330e-ed18-4c84-bd28-ca464c968ebf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Updating instance_info_cache with network_info: [{"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Releasing lock "refresh_cache-ea52330e-ed18-4c84-bd28-ca464c968ebf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Instance network_info: |[{"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] Acquired lock "refresh_cache-ea52330e-ed18-4c84-bd28-ca464c968ebf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.neutron [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Refreshing network info cache for port e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Start _get_guest_xml network_info=[{"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:42:18 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:42:18 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2064093302',display_name='tempest-VolumesAdminNegativeTest-server-2064093302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2064093302',id=14,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426a7cafbfd54c23a56c584b9107d871',ramdisk_id='',reservation_id='r-5mtrqek6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2110311291',owner_user_name='tempest-VolumesAdminNegativeTest-2110311291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:42:17Z,user_data=None,user_id='e28e6b2894c844ae864b0283b8824371',uuid=ea52330e-ed18-4c84-bd28-ca464c968ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converting VIF {"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'pci_devices' on Instance uuid ea52330e-ed18-4c84-bd28-ca464c968ebf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:42:18 user nova-compute[75233]:   <uuid>ea52330e-ed18-4c84-bd28-ca464c968ebf</uuid>
Dec 05 13:42:18 user nova-compute[75233]:   <name>instance-0000000e</name>
Dec 05 13:42:18 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:42:18 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:42:18 user nova-compute[75233]:   <metadata>
Dec 05 13:42:18 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:18 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:42:18 user nova-compute[75233]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2064093302</nova:name>
Dec 05 13:42:18 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:42:18</nova:creationTime>
Dec 05 13:42:18 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:42:18 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:18 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:42:18 user nova-compute[75233]:       <nova:owner>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:user uuid="e28e6b2894c844ae864b0283b8824371">tempest-VolumesAdminNegativeTest-2110311291-project-member</nova:user>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:project uuid="426a7cafbfd54c23a56c584b9107d871">tempest-VolumesAdminNegativeTest-2110311291</nova:project>
Dec 05 13:42:18 user nova-compute[75233]:       </nova:owner>
Dec 05 13:42:18 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:18 user nova-compute[75233]:       <nova:ports>
Dec 05 13:42:18 user nova-compute[75233]:         <nova:port uuid="e298c0ed-2f03-4558-8a92-e6172b076cfe">
Dec 05 13:42:18 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 13:42:18 user nova-compute[75233]:         </nova:port>
Dec 05 13:42:18 user nova-compute[75233]:       </nova:ports>
Dec 05 13:42:18 user nova-compute[75233]:     </nova:instance>
Dec 05 13:42:18 user nova-compute[75233]:   </metadata>
Dec 05 13:42:18 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:42:18 user nova-compute[75233]:     <system>
Dec 05 13:42:18 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:42:18 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:42:18 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:42:18 user nova-compute[75233]:       <entry name="serial">ea52330e-ed18-4c84-bd28-ca464c968ebf</entry>
Dec 05 13:42:18 user nova-compute[75233]:       <entry name="uuid">ea52330e-ed18-4c84-bd28-ca464c968ebf</entry>
Dec 05 13:42:18 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:42:18 user nova-compute[75233]:     </system>
Dec 05 13:42:18 user nova-compute[75233]:   </sysinfo>
Dec 05 13:42:18 user nova-compute[75233]:   <os>
Dec 05 13:42:18 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:42:18 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:42:18 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:42:18 user nova-compute[75233]:   </os>
Dec 05 13:42:18 user nova-compute[75233]:   <features>
Dec 05 13:42:18 user nova-compute[75233]:     <acpi/>
Dec 05 13:42:18 user nova-compute[75233]:     <apic/>
Dec 05 13:42:18 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:42:18 user nova-compute[75233]:   </features>
Dec 05 13:42:18 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:42:18 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:42:18 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:42:18 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:42:18 user nova-compute[75233]:   </clock>
Dec 05 13:42:18 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:42:18 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:42:18 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:42:18 user nova-compute[75233]:   </cpu>
Dec 05 13:42:18 user nova-compute[75233]:   <devices>
Dec 05 13:42:18 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:42:18 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:42:18 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk"/>
Dec 05 13:42:18 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:42:18 user nova-compute[75233]:     </disk>
Dec 05 13:42:18 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:42:18 user nova-compute[75233]:       <mac address="fa:16:3e:f8:4b:d0"/>
Dec 05 13:42:18 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:42:18 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:42:18 user nova-compute[75233]:       <target dev="tape298c0ed-2f"/>
Dec 05 13:42:18 user nova-compute[75233]:     </interface>
Dec 05 13:42:18 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:42:18 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/console.log" append="off"/>
Dec 05 13:42:18 user nova-compute[75233]:     </serial>
Dec 05 13:42:18 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:42:18 user nova-compute[75233]:     <video>
Dec 05 13:42:18 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:42:18 user nova-compute[75233]:     </video>
Dec 05 13:42:18 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:42:18 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:42:18 user nova-compute[75233]:     </rng>
Dec 05 13:42:18 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:42:18 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:42:18 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:42:18 user nova-compute[75233]:     </memballoon>
Dec 05 13:42:18 user nova-compute[75233]:   </devices>
Dec 05 13:42:18 user nova-compute[75233]: </domain>
Dec 05 13:42:18 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2064093302',display_name='tempest-VolumesAdminNegativeTest-server-2064093302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2064093302',id=14,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426a7cafbfd54c23a56c584b9107d871',ramdisk_id='',reservation_id='r-5mtrqek6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2110311291',owner_user_name='tempest-VolumesAdminNegativeTest-2110311291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:42:17Z,user_data=None,user_id='e28e6b2894c844ae864b0283b8824371',uuid=ea52330e-ed18-4c84-bd28-ca464c968ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converting VIF {"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG os_vif [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06526c7e-9285-547a-8b1b-39e33c85d0c8', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape298c0ed-2f, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape298c0ed-2f, col_values=(('qos', UUID('70e87e3b-b9be-4780-8aa3-0f683ef472cf')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape298c0ed-2f, col_values=(('external_ids', {'iface-id': 'e298c0ed-2f03-4558-8a92-e6172b076cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:4b:d0', 'vm-uuid': 'ea52330e-ed18-4c84-bd28-ca464c968ebf'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:18 user nova-compute[75233]: INFO os_vif [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f')
Dec 05 13:42:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:42:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] No VIF found with MAC fa:16:3e:f8:4b:d0, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:42:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Updated VIF entry in instance network info cache for port e298c0ed-2f03-4558-8a92-e6172b076cfe. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:42:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Updating instance_info_cache with network_info: [{"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fbdd99c0-321f-4d00-809f-755527d378e1 req-ee48aa9d-2cb7-49ba-af56-ef0eb49a65a1 service nova] Releasing lock "refresh_cache-ea52330e-ed18-4c84-bd28-ca464c968ebf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-69ac221f-842c-478d-ad21-2d7dde287047 req-7863f86f-a394-4737-9407-a1fe3834517c service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Received event network-vif-plugged-e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69ac221f-842c-478d-ad21-2d7dde287047 req-7863f86f-a394-4737-9407-a1fe3834517c service nova] Acquiring lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69ac221f-842c-478d-ad21-2d7dde287047 req-7863f86f-a394-4737-9407-a1fe3834517c service nova] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69ac221f-842c-478d-ad21-2d7dde287047 req-7863f86f-a394-4737-9407-a1fe3834517c service nova] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-69ac221f-842c-478d-ad21-2d7dde287047 req-7863f86f-a394-4737-9407-a1fe3834517c service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] No waiting events found dispatching network-vif-plugged-e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:20 user nova-compute[75233]: WARNING nova.compute.manager [req-69ac221f-842c-478d-ad21-2d7dde287047 req-7863f86f-a394-4737-9407-a1fe3834517c service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Received unexpected event network-vif-plugged-e298c0ed-2f03-4558-8a92-e6172b076cfe for instance with vm_state building and task_state spawning.
Dec 05 13:42:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:42:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Instance spawned successfully.
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:42:22 user nova-compute[75233]: INFO nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Took 5.01 seconds to spawn the instance on the hypervisor.
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-3aace3dd-d3f8-4d3b-bfbb-541bc7d2e80a req-2011ee58-b80e-4d5c-9025-02beacbb27b0 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Received event network-vif-plugged-e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3aace3dd-d3f8-4d3b-bfbb-541bc7d2e80a req-2011ee58-b80e-4d5c-9025-02beacbb27b0 service nova] Acquiring lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3aace3dd-d3f8-4d3b-bfbb-541bc7d2e80a req-2011ee58-b80e-4d5c-9025-02beacbb27b0 service nova] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3aace3dd-d3f8-4d3b-bfbb-541bc7d2e80a req-2011ee58-b80e-4d5c-9025-02beacbb27b0 service nova] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-3aace3dd-d3f8-4d3b-bfbb-541bc7d2e80a req-2011ee58-b80e-4d5c-9025-02beacbb27b0 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] No waiting events found dispatching network-vif-plugged-e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:22 user nova-compute[75233]: WARNING nova.compute.manager [req-3aace3dd-d3f8-4d3b-bfbb-541bc7d2e80a req-2011ee58-b80e-4d5c-9025-02beacbb27b0 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Received unexpected event network-vif-plugged-e298c0ed-2f03-4558-8a92-e6172b076cfe for instance with vm_state building and task_state spawning.
Dec 05 13:42:22 user nova-compute[75233]: INFO nova.compute.manager [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Took 5.82 seconds to build instance.
Dec 05 13:42:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d7ee805-7377-402e-b44c-601abf32d214 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.933s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:27 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Waiting for libvirt event about the detach of device tap35026b32-2e with device alias net1 from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c is timed out.
Dec 05 13:42:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface> {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 05 13:42:27 user nova-compute[75233]:   <name>instance-00000007</name>
Dec 05 13:42:27 user nova-compute[75233]:   <uuid>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</uuid>
Dec 05 13:42:27 user nova-compute[75233]:   <metadata>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:27 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:41:16</nova:creationTime>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:42:27 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:27 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:owner>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:42:27 user nova-compute[75233]:   </nova:owner>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:ports>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:42:27 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:42:27 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:port uuid="35026b32-2e65-4fe9-8e7f-0728c86624e1">
Dec 05 13:42:27 user nova-compute[75233]:       <nova:ip type="fixed" address="10.10.10.126" ipVersion="4"/>
Dec 05 13:42:27 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:27 user nova-compute[75233]:   </nova:ports>
Dec 05 13:42:27 user nova-compute[75233]: </nova:instance>
Dec 05 13:42:27 user nova-compute[75233]:   </metadata>
Dec 05 13:42:27 user nova-compute[75233]:   <memory unit='KiB'>524288</memory>
Dec 05 13:42:27 user nova-compute[75233]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 13:42:27 user nova-compute[75233]:   <vcpu placement='static'>1</vcpu>
Dec 05 13:42:27 user nova-compute[75233]:   <resource>
Dec 05 13:42:27 user nova-compute[75233]:     <partition>/machine</partition>
Dec 05 13:42:27 user nova-compute[75233]:   </resource>
Dec 05 13:42:27 user nova-compute[75233]:   <sysinfo type='smbios'>
Dec 05 13:42:27 user nova-compute[75233]:     <system>
Dec 05 13:42:27 user nova-compute[75233]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 13:42:27 user nova-compute[75233]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 13:42:27 user nova-compute[75233]:       <entry name='version'>0.0.0</entry>
Dec 05 13:42:27 user nova-compute[75233]:       <entry name='serial'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:27 user nova-compute[75233]:       <entry name='uuid'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:27 user nova-compute[75233]:       <entry name='family'>Virtual Machine</entry>
Dec 05 13:42:27 user nova-compute[75233]:     </system>
Dec 05 13:42:27 user nova-compute[75233]:   </sysinfo>
Dec 05 13:42:27 user nova-compute[75233]:   <os>
Dec 05 13:42:27 user nova-compute[75233]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 13:42:27 user nova-compute[75233]:     <boot dev='hd'/>
Dec 05 13:42:27 user nova-compute[75233]:     <smbios mode='sysinfo'/>
Dec 05 13:42:27 user nova-compute[75233]:   </os>
Dec 05 13:42:27 user nova-compute[75233]:   <features>
Dec 05 13:42:27 user nova-compute[75233]:     <acpi/>
Dec 05 13:42:27 user nova-compute[75233]:     <apic/>
Dec 05 13:42:27 user nova-compute[75233]:     <vmcoreinfo state='on'/>
Dec 05 13:42:27 user nova-compute[75233]:   </features>
Dec 05 13:42:27 user nova-compute[75233]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 13:42:27 user nova-compute[75233]:     <model fallback='forbid'>Nehalem</model>
Dec 05 13:42:27 user nova-compute[75233]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 13:42:27 user nova-compute[75233]:     <feature policy='require' name='vme'/>
Dec 05 13:42:27 user nova-compute[75233]:     <feature policy='require' name='x2apic'/>
Dec 05 13:42:27 user nova-compute[75233]:     <feature policy='require' name='hypervisor'/>
Dec 05 13:42:27 user nova-compute[75233]:   </cpu>
Dec 05 13:42:27 user nova-compute[75233]:   <clock offset='utc'>
Dec 05 13:42:27 user nova-compute[75233]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 13:42:27 user nova-compute[75233]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 13:42:27 user nova-compute[75233]:     <timer name='hpet' present='no'/>
Dec 05 13:42:27 user nova-compute[75233]:   </clock>
Dec 05 13:42:27 user nova-compute[75233]:   <on_poweroff>destroy</on_poweroff>
Dec 05 13:42:27 user nova-compute[75233]:   <on_reboot>restart</on_reboot>
Dec 05 13:42:27 user nova-compute[75233]:   <on_crash>destroy</on_crash>
Dec 05 13:42:27 user nova-compute[75233]:   <devices>
Dec 05 13:42:27 user nova-compute[75233]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 13:42:27 user nova-compute[75233]:     <disk type='file' device='disk'>
Dec 05 13:42:27 user nova-compute[75233]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 13:42:27 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk' index='2'/>
Dec 05 13:42:27 user nova-compute[75233]:       <backingStore type='file' index='3'>
Dec 05 13:42:27 user nova-compute[75233]:         <format type='raw'/>
Dec 05 13:42:27 user nova-compute[75233]:         <source file='/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec'/>
Dec 05 13:42:27 user nova-compute[75233]:         <backingStore/>
Dec 05 13:42:27 user nova-compute[75233]:       </backingStore>
Dec 05 13:42:27 user nova-compute[75233]:       <target dev='vda' bus='virtio'/>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='virtio-disk0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </disk>
Dec 05 13:42:27 user nova-compute[75233]:     <disk type='file' device='cdrom'>
Dec 05 13:42:27 user nova-compute[75233]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 13:42:27 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config' index='1'/>
Dec 05 13:42:27 user nova-compute[75233]:       <backingStore/>
Dec 05 13:42:27 user nova-compute[75233]:       <target dev='hda' bus='ide'/>
Dec 05 13:42:27 user nova-compute[75233]:       <readonly/>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='ide0-0-0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </disk>
Dec 05 13:42:27 user nova-compute[75233]:     <controller type='usb' index='0' model='none'>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='usb'/>
Dec 05 13:42:27 user nova-compute[75233]:     </controller>
Dec 05 13:42:27 user nova-compute[75233]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='pci.0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </controller>
Dec 05 13:42:27 user nova-compute[75233]:     <controller type='ide' index='0'>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='ide'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 13:42:27 user nova-compute[75233]:     </controller>
Dec 05 13:42:27 user nova-compute[75233]:     <interface type='ethernet'>
Dec 05 13:42:27 user nova-compute[75233]:       <mac address='fa:16:3e:73:8c:03'/>
Dec 05 13:42:27 user nova-compute[75233]:       <target dev='tap1ad882c8-81'/>
Dec 05 13:42:27 user nova-compute[75233]:       <model type='virtio'/>
Dec 05 13:42:27 user nova-compute[75233]:       <mtu size='1442'/>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='net0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </interface>
Dec 05 13:42:27 user nova-compute[75233]:     <serial type='pty'>
Dec 05 13:42:27 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:27 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:27 user nova-compute[75233]:       <target type='isa-serial' port='0'>
Dec 05 13:42:27 user nova-compute[75233]:         <model name='isa-serial'/>
Dec 05 13:42:27 user nova-compute[75233]:       </target>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </serial>
Dec 05 13:42:27 user nova-compute[75233]:     <console type='pty' tty='/dev/pts/6'>
Dec 05 13:42:27 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:27 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:27 user nova-compute[75233]:       <target type='serial' port='0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </console>
Dec 05 13:42:27 user nova-compute[75233]:     <input type='mouse' bus='ps2'>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='input0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </input>
Dec 05 13:42:27 user nova-compute[75233]:     <input type='keyboard' bus='ps2'>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='input1'/>
Dec 05 13:42:27 user nova-compute[75233]:     </input>
Dec 05 13:42:27 user nova-compute[75233]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 05 13:42:27 user nova-compute[75233]:       <listen type='address' address='0.0.0.0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </graphics>
Dec 05 13:42:27 user nova-compute[75233]:     <audio id='1' type='none'/>
Dec 05 13:42:27 user nova-compute[75233]:     <video>
Dec 05 13:42:27 user nova-compute[75233]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='video0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </video>
Dec 05 13:42:27 user nova-compute[75233]:     <memballoon model='virtio'>
Dec 05 13:42:27 user nova-compute[75233]:       <stats period='10'/>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='balloon0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </memballoon>
Dec 05 13:42:27 user nova-compute[75233]:     <rng model='virtio'>
Dec 05 13:42:27 user nova-compute[75233]:       <backend model='random'>/dev/urandom</backend>
Dec 05 13:42:27 user nova-compute[75233]:       <alias name='rng0'/>
Dec 05 13:42:27 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 13:42:27 user nova-compute[75233]:     </rng>
Dec 05 13:42:27 user nova-compute[75233]:   </devices>
Dec 05 13:42:27 user nova-compute[75233]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 13:42:27 user nova-compute[75233]:     <label>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</label>
Dec 05 13:42:27 user nova-compute[75233]:     <imagelabel>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</imagelabel>
Dec 05 13:42:27 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:27 user nova-compute[75233]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 13:42:27 user nova-compute[75233]:     <label>+64055:+108</label>
Dec 05 13:42:27 user nova-compute[75233]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 13:42:27 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:27 user nova-compute[75233]: </domain>
Dec 05 13:42:27 user nova-compute[75233]:  {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 13:42:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully detached device tap35026b32-2e from instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c from the live domain config.
Dec 05 13:42:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG os_vif [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35026b32-2e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57a9de82-6cb2-4637-8748-3a3d030e37e9) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:27 user nova-compute[75233]: INFO os_vif [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e')
Dec 05 13:42:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:27 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:42:27</nova:creationTime>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:42:27 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:27 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:owner>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:42:27 user nova-compute[75233]:   </nova:owner>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:27 user nova-compute[75233]:   <nova:ports>
Dec 05 13:42:27 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:42:27 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:42:27 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:27 user nova-compute[75233]:   </nova:ports>
Dec 05 13:42:27 user nova-compute[75233]: </nova:instance>
Dec 05 13:42:27 user nova-compute[75233]:  {{(pid=75233) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-deleted-35026b32-2e65-4fe9-8e7f-0728c86624e1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:28 user nova-compute[75233]: INFO nova.compute.manager [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Neutron deleted interface 35026b32-2e65-4fe9-8e7f-0728c86624e1; detaching it from the instance and deleting it from the info cache
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.neutron [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquired lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.objects.instance [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Lazy-loading 'system_metadata' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.objects.instance [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Lazy-loading 'flavor' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.objects.base [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Object Instance<cf62dc1b-8a7e-48ac-88e7-420ce6b9851c> lazy-loaded attributes: system_metadata,flavor {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Converting VIF {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface> {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 05 13:42:28 user nova-compute[75233]:   <name>instance-00000007</name>
Dec 05 13:42:28 user nova-compute[75233]:   <uuid>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</uuid>
Dec 05 13:42:28 user nova-compute[75233]:   <metadata>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:28 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:42:27</nova:creationTime>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:42:28 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:owner>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:owner>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:ports>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:42:28 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:42:28 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:ports>
Dec 05 13:42:28 user nova-compute[75233]: </nova:instance>
Dec 05 13:42:28 user nova-compute[75233]:   </metadata>
Dec 05 13:42:28 user nova-compute[75233]:   <memory unit='KiB'>524288</memory>
Dec 05 13:42:28 user nova-compute[75233]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 13:42:28 user nova-compute[75233]:   <vcpu placement='static'>1</vcpu>
Dec 05 13:42:28 user nova-compute[75233]:   <resource>
Dec 05 13:42:28 user nova-compute[75233]:     <partition>/machine</partition>
Dec 05 13:42:28 user nova-compute[75233]:   </resource>
Dec 05 13:42:28 user nova-compute[75233]:   <sysinfo type='smbios'>
Dec 05 13:42:28 user nova-compute[75233]:     <system>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='version'>0.0.0</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='serial'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='uuid'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='family'>Virtual Machine</entry>
Dec 05 13:42:28 user nova-compute[75233]:     </system>
Dec 05 13:42:28 user nova-compute[75233]:   </sysinfo>
Dec 05 13:42:28 user nova-compute[75233]:   <os>
Dec 05 13:42:28 user nova-compute[75233]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 13:42:28 user nova-compute[75233]:     <boot dev='hd'/>
Dec 05 13:42:28 user nova-compute[75233]:     <smbios mode='sysinfo'/>
Dec 05 13:42:28 user nova-compute[75233]:   </os>
Dec 05 13:42:28 user nova-compute[75233]:   <features>
Dec 05 13:42:28 user nova-compute[75233]:     <acpi/>
Dec 05 13:42:28 user nova-compute[75233]:     <apic/>
Dec 05 13:42:28 user nova-compute[75233]:     <vmcoreinfo state='on'/>
Dec 05 13:42:28 user nova-compute[75233]:   </features>
Dec 05 13:42:28 user nova-compute[75233]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 13:42:28 user nova-compute[75233]:     <model fallback='forbid'>Nehalem</model>
Dec 05 13:42:28 user nova-compute[75233]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 13:42:28 user nova-compute[75233]:     <feature policy='require' name='vme'/>
Dec 05 13:42:28 user nova-compute[75233]:     <feature policy='require' name='x2apic'/>
Dec 05 13:42:28 user nova-compute[75233]:     <feature policy='require' name='hypervisor'/>
Dec 05 13:42:28 user nova-compute[75233]:   </cpu>
Dec 05 13:42:28 user nova-compute[75233]:   <clock offset='utc'>
Dec 05 13:42:28 user nova-compute[75233]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 13:42:28 user nova-compute[75233]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 13:42:28 user nova-compute[75233]:     <timer name='hpet' present='no'/>
Dec 05 13:42:28 user nova-compute[75233]:   </clock>
Dec 05 13:42:28 user nova-compute[75233]:   <on_poweroff>destroy</on_poweroff>
Dec 05 13:42:28 user nova-compute[75233]:   <on_reboot>restart</on_reboot>
Dec 05 13:42:28 user nova-compute[75233]:   <on_crash>destroy</on_crash>
Dec 05 13:42:28 user nova-compute[75233]:   <devices>
Dec 05 13:42:28 user nova-compute[75233]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 13:42:28 user nova-compute[75233]:     <disk type='file' device='disk'>
Dec 05 13:42:28 user nova-compute[75233]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 13:42:28 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk' index='2'/>
Dec 05 13:42:28 user nova-compute[75233]:       <backingStore type='file' index='3'>
Dec 05 13:42:28 user nova-compute[75233]:         <format type='raw'/>
Dec 05 13:42:28 user nova-compute[75233]:         <source file='/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec'/>
Dec 05 13:42:28 user nova-compute[75233]:         <backingStore/>
Dec 05 13:42:28 user nova-compute[75233]:       </backingStore>
Dec 05 13:42:28 user nova-compute[75233]:       <target dev='vda' bus='virtio'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='virtio-disk0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </disk>
Dec 05 13:42:28 user nova-compute[75233]:     <disk type='file' device='cdrom'>
Dec 05 13:42:28 user nova-compute[75233]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 13:42:28 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config' index='1'/>
Dec 05 13:42:28 user nova-compute[75233]:       <backingStore/>
Dec 05 13:42:28 user nova-compute[75233]:       <target dev='hda' bus='ide'/>
Dec 05 13:42:28 user nova-compute[75233]:       <readonly/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='ide0-0-0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </disk>
Dec 05 13:42:28 user nova-compute[75233]:     <controller type='usb' index='0' model='none'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='usb'/>
Dec 05 13:42:28 user nova-compute[75233]:     </controller>
Dec 05 13:42:28 user nova-compute[75233]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='pci.0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </controller>
Dec 05 13:42:28 user nova-compute[75233]:     <controller type='ide' index='0'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='ide'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 13:42:28 user nova-compute[75233]:     </controller>
Dec 05 13:42:28 user nova-compute[75233]:     <interface type='ethernet'>
Dec 05 13:42:28 user nova-compute[75233]:       <mac address='fa:16:3e:73:8c:03'/>
Dec 05 13:42:28 user nova-compute[75233]:       <target dev='tap1ad882c8-81'/>
Dec 05 13:42:28 user nova-compute[75233]:       <model type='virtio'/>
Dec 05 13:42:28 user nova-compute[75233]:       <mtu size='1442'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='net0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </interface>
Dec 05 13:42:28 user nova-compute[75233]:     <serial type='pty'>
Dec 05 13:42:28 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:28 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:28 user nova-compute[75233]:       <target type='isa-serial' port='0'>
Dec 05 13:42:28 user nova-compute[75233]:         <model name='isa-serial'/>
Dec 05 13:42:28 user nova-compute[75233]:       </target>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </serial>
Dec 05 13:42:28 user nova-compute[75233]:     <console type='pty' tty='/dev/pts/6'>
Dec 05 13:42:28 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:28 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:28 user nova-compute[75233]:       <target type='serial' port='0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </console>
Dec 05 13:42:28 user nova-compute[75233]:     <input type='mouse' bus='ps2'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='input0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </input>
Dec 05 13:42:28 user nova-compute[75233]:     <input type='keyboard' bus='ps2'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='input1'/>
Dec 05 13:42:28 user nova-compute[75233]:     </input>
Dec 05 13:42:28 user nova-compute[75233]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 05 13:42:28 user nova-compute[75233]:       <listen type='address' address='0.0.0.0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </graphics>
Dec 05 13:42:28 user nova-compute[75233]:     <audio id='1' type='none'/>
Dec 05 13:42:28 user nova-compute[75233]:     <video>
Dec 05 13:42:28 user nova-compute[75233]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='video0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </video>
Dec 05 13:42:28 user nova-compute[75233]:     <memballoon model='virtio'>
Dec 05 13:42:28 user nova-compute[75233]:       <stats period='10'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='balloon0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </memballoon>
Dec 05 13:42:28 user nova-compute[75233]:     <rng model='virtio'>
Dec 05 13:42:28 user nova-compute[75233]:       <backend model='random'>/dev/urandom</backend>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='rng0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </rng>
Dec 05 13:42:28 user nova-compute[75233]:   </devices>
Dec 05 13:42:28 user nova-compute[75233]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 13:42:28 user nova-compute[75233]:     <label>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</label>
Dec 05 13:42:28 user nova-compute[75233]:     <imagelabel>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</imagelabel>
Dec 05 13:42:28 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:28 user nova-compute[75233]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 13:42:28 user nova-compute[75233]:     <label>+64055:+108</label>
Dec 05 13:42:28 user nova-compute[75233]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 13:42:28 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:28 user nova-compute[75233]: </domain>
Dec 05 13:42:28 user nova-compute[75233]:  {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface> {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:c8:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap35026b32-2e"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 05 13:42:28 user nova-compute[75233]:   <name>instance-00000007</name>
Dec 05 13:42:28 user nova-compute[75233]:   <uuid>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</uuid>
Dec 05 13:42:28 user nova-compute[75233]:   <metadata>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:28 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:42:27</nova:creationTime>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:42:28 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:owner>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:owner>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:ports>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:42:28 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:42:28 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:ports>
Dec 05 13:42:28 user nova-compute[75233]: </nova:instance>
Dec 05 13:42:28 user nova-compute[75233]:   </metadata>
Dec 05 13:42:28 user nova-compute[75233]:   <memory unit='KiB'>524288</memory>
Dec 05 13:42:28 user nova-compute[75233]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 13:42:28 user nova-compute[75233]:   <vcpu placement='static'>1</vcpu>
Dec 05 13:42:28 user nova-compute[75233]:   <resource>
Dec 05 13:42:28 user nova-compute[75233]:     <partition>/machine</partition>
Dec 05 13:42:28 user nova-compute[75233]:   </resource>
Dec 05 13:42:28 user nova-compute[75233]:   <sysinfo type='smbios'>
Dec 05 13:42:28 user nova-compute[75233]:     <system>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='version'>0.0.0</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='serial'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='uuid'>cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</entry>
Dec 05 13:42:28 user nova-compute[75233]:       <entry name='family'>Virtual Machine</entry>
Dec 05 13:42:28 user nova-compute[75233]:     </system>
Dec 05 13:42:28 user nova-compute[75233]:   </sysinfo>
Dec 05 13:42:28 user nova-compute[75233]:   <os>
Dec 05 13:42:28 user nova-compute[75233]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 13:42:28 user nova-compute[75233]:     <boot dev='hd'/>
Dec 05 13:42:28 user nova-compute[75233]:     <smbios mode='sysinfo'/>
Dec 05 13:42:28 user nova-compute[75233]:   </os>
Dec 05 13:42:28 user nova-compute[75233]:   <features>
Dec 05 13:42:28 user nova-compute[75233]:     <acpi/>
Dec 05 13:42:28 user nova-compute[75233]:     <apic/>
Dec 05 13:42:28 user nova-compute[75233]:     <vmcoreinfo state='on'/>
Dec 05 13:42:28 user nova-compute[75233]:   </features>
Dec 05 13:42:28 user nova-compute[75233]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 13:42:28 user nova-compute[75233]:     <model fallback='forbid'>Nehalem</model>
Dec 05 13:42:28 user nova-compute[75233]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 13:42:28 user nova-compute[75233]:     <feature policy='require' name='vme'/>
Dec 05 13:42:28 user nova-compute[75233]:     <feature policy='require' name='x2apic'/>
Dec 05 13:42:28 user nova-compute[75233]:     <feature policy='require' name='hypervisor'/>
Dec 05 13:42:28 user nova-compute[75233]:   </cpu>
Dec 05 13:42:28 user nova-compute[75233]:   <clock offset='utc'>
Dec 05 13:42:28 user nova-compute[75233]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 13:42:28 user nova-compute[75233]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 13:42:28 user nova-compute[75233]:     <timer name='hpet' present='no'/>
Dec 05 13:42:28 user nova-compute[75233]:   </clock>
Dec 05 13:42:28 user nova-compute[75233]:   <on_poweroff>destroy</on_poweroff>
Dec 05 13:42:28 user nova-compute[75233]:   <on_reboot>restart</on_reboot>
Dec 05 13:42:28 user nova-compute[75233]:   <on_crash>destroy</on_crash>
Dec 05 13:42:28 user nova-compute[75233]:   <devices>
Dec 05 13:42:28 user nova-compute[75233]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 13:42:28 user nova-compute[75233]:     <disk type='file' device='disk'>
Dec 05 13:42:28 user nova-compute[75233]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 13:42:28 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk' index='2'/>
Dec 05 13:42:28 user nova-compute[75233]:       <backingStore type='file' index='3'>
Dec 05 13:42:28 user nova-compute[75233]:         <format type='raw'/>
Dec 05 13:42:28 user nova-compute[75233]:         <source file='/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec'/>
Dec 05 13:42:28 user nova-compute[75233]:         <backingStore/>
Dec 05 13:42:28 user nova-compute[75233]:       </backingStore>
Dec 05 13:42:28 user nova-compute[75233]:       <target dev='vda' bus='virtio'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='virtio-disk0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </disk>
Dec 05 13:42:28 user nova-compute[75233]:     <disk type='file' device='cdrom'>
Dec 05 13:42:28 user nova-compute[75233]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 13:42:28 user nova-compute[75233]:       <source file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk.config' index='1'/>
Dec 05 13:42:28 user nova-compute[75233]:       <backingStore/>
Dec 05 13:42:28 user nova-compute[75233]:       <target dev='hda' bus='ide'/>
Dec 05 13:42:28 user nova-compute[75233]:       <readonly/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='ide0-0-0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </disk>
Dec 05 13:42:28 user nova-compute[75233]:     <controller type='usb' index='0' model='none'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='usb'/>
Dec 05 13:42:28 user nova-compute[75233]:     </controller>
Dec 05 13:42:28 user nova-compute[75233]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='pci.0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </controller>
Dec 05 13:42:28 user nova-compute[75233]:     <controller type='ide' index='0'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='ide'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 13:42:28 user nova-compute[75233]:     </controller>
Dec 05 13:42:28 user nova-compute[75233]:     <interface type='ethernet'>
Dec 05 13:42:28 user nova-compute[75233]:       <mac address='fa:16:3e:73:8c:03'/>
Dec 05 13:42:28 user nova-compute[75233]:       <target dev='tap1ad882c8-81'/>
Dec 05 13:42:28 user nova-compute[75233]:       <model type='virtio'/>
Dec 05 13:42:28 user nova-compute[75233]:       <mtu size='1442'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='net0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </interface>
Dec 05 13:42:28 user nova-compute[75233]:     <serial type='pty'>
Dec 05 13:42:28 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:28 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:28 user nova-compute[75233]:       <target type='isa-serial' port='0'>
Dec 05 13:42:28 user nova-compute[75233]:         <model name='isa-serial'/>
Dec 05 13:42:28 user nova-compute[75233]:       </target>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </serial>
Dec 05 13:42:28 user nova-compute[75233]:     <console type='pty' tty='/dev/pts/6'>
Dec 05 13:42:28 user nova-compute[75233]:       <source path='/dev/pts/6'/>
Dec 05 13:42:28 user nova-compute[75233]:       <log file='/opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/console.log' append='off'/>
Dec 05 13:42:28 user nova-compute[75233]:       <target type='serial' port='0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='serial0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </console>
Dec 05 13:42:28 user nova-compute[75233]:     <input type='mouse' bus='ps2'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='input0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </input>
Dec 05 13:42:28 user nova-compute[75233]:     <input type='keyboard' bus='ps2'>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='input1'/>
Dec 05 13:42:28 user nova-compute[75233]:     </input>
Dec 05 13:42:28 user nova-compute[75233]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 05 13:42:28 user nova-compute[75233]:       <listen type='address' address='0.0.0.0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </graphics>
Dec 05 13:42:28 user nova-compute[75233]:     <audio id='1' type='none'/>
Dec 05 13:42:28 user nova-compute[75233]:     <video>
Dec 05 13:42:28 user nova-compute[75233]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='video0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </video>
Dec 05 13:42:28 user nova-compute[75233]:     <memballoon model='virtio'>
Dec 05 13:42:28 user nova-compute[75233]:       <stats period='10'/>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='balloon0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </memballoon>
Dec 05 13:42:28 user nova-compute[75233]:     <rng model='virtio'>
Dec 05 13:42:28 user nova-compute[75233]:       <backend model='random'>/dev/urandom</backend>
Dec 05 13:42:28 user nova-compute[75233]:       <alias name='rng0'/>
Dec 05 13:42:28 user nova-compute[75233]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 13:42:28 user nova-compute[75233]:     </rng>
Dec 05 13:42:28 user nova-compute[75233]:   </devices>
Dec 05 13:42:28 user nova-compute[75233]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 13:42:28 user nova-compute[75233]:     <label>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</label>
Dec 05 13:42:28 user nova-compute[75233]:     <imagelabel>libvirt-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c</imagelabel>
Dec 05 13:42:28 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:28 user nova-compute[75233]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 13:42:28 user nova-compute[75233]:     <label>+64055:+108</label>
Dec 05 13:42:28 user nova-compute[75233]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 13:42:28 user nova-compute[75233]:   </seclabel>
Dec 05 13:42:28 user nova-compute[75233]: </domain>
Dec 05 13:42:28 user nova-compute[75233]:  {{(pid=75233) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 13:42:28 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Detaching interface fa:16:3e:f1:c8:bf failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap35026b32-2e' not found.
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Converting VIF {"id": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "address": "fa:16:3e:f1:c8:bf", "network": {"id": "b79b9881-3164-4501-8819-a47608e4a308", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1454207349", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35026b32-2e", "ovs_interfaceid": "35026b32-2e65-4fe9-8e7f-0728c86624e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG os_vif [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35026b32-2e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:42:28 user nova-compute[75233]: INFO os_vif [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:c8:bf,bridge_name='br-int',has_traffic_filtering=True,id=35026b32-2e65-4fe9-8e7f-0728c86624e1,network=Network(b79b9881-3164-4501-8819-a47608e4a308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35026b32-2e')
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [req-77e4b153-4c92-4aee-8d5d-33c6a8373a29 req-07d8e915-81d2-4f2f-9e0d-b76089c39fc0 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:42:28 user nova-compute[75233]:   <nova:package version="0.0.0"/>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:name>tempest-device-tagging-server-1944126899</nova:name>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:creationTime>2023-12-05 13:42:28</nova:creationTime>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:flavor name="m1.tiny">
Dec 05 13:42:28 user nova-compute[75233]:     <nova:memory>512</nova:memory>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:disk>1</nova:disk>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:swap>0</nova:swap>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:vcpus>1</nova:vcpus>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:flavor>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:owner>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:user uuid="7b7c7ad4b6e3420eb9b1458993a83420">tempest-TaggedAttachmentsTest-930674786-project-member</nova:user>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:project uuid="b9f74e2293c74d82b37d4bdd6c9db8b1">tempest-TaggedAttachmentsTest-930674786</nova:project>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:owner>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:42:28 user nova-compute[75233]:   <nova:ports>
Dec 05 13:42:28 user nova-compute[75233]:     <nova:port uuid="1ad882c8-81f9-48ed-a978-734805dd9564">
Dec 05 13:42:28 user nova-compute[75233]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:42:28 user nova-compute[75233]:     </nova:port>
Dec 05 13:42:28 user nova-compute[75233]:   </nova:ports>
Dec 05 13:42:28 user nova-compute[75233]: </nova:instance>
Dec 05 13:42:28 user nova-compute[75233]:  {{(pid=75233) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [{"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Releasing lock "refresh_cache-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ec45789-6e49-40f1-b31b-8832a8586968 tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "interface-cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-35026b32-2e65-4fe9-8e7f-0728c86624e1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.540s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61b72e12-781d-472c-841d-59cacd38578f is timed out.
Dec 05 13:42:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Successfully detached device vdb from instance 61b72e12-781d-472c-841d-59cacd38578f from the live domain config.
Dec 05 13:42:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFSNsOqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'a78ebbc6-fd4d-45b7-a525-c79b826f4342'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a2b32-0614-4939-a5c1-3cb67acfd445]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:32 user nova-compute[75233]: No targets found.
Dec 05 13:42:32 user nova-compute[75233]: iSNS:
Dec 05 13:42:32 user nova-compute[75233]: No targets found.
Dec 05 13:42:32 user nova-compute[75233]: STATIC:
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:42:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:32 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:32 user nova-compute[75233]: No targets found.
Dec 05 13:42:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:32 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:32 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbcfe3f-5f74-46f6-b029-e44770ddb420]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d03f5e-c8c0-4449-992b-419fd7f63463]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:33 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582cf640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342'): ({'sdi'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Removing single pathed devices sdi {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb2819-b33d-48e4-b293-f765d416bc19]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4b107-127d-424c-8ec2-4d29d4774379]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Flushing IO for device /dev/sdi {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb81542-4949-4379-91ae-d4e8fa373fb5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4f610d-6707-486c-89eb-7a1ab38c95c6]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] SCSI volumes sdi have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08846d0e-25a1-4a2c-abe7-5a2400c6385c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc4c9f-6a73-4031-b333-6a4cf25f6d42]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260]
Dec 05 13:42:33 user nova-compute[75233]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78ebbc6-fd4d-45b7-a525-c79b826f4342 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f51395-ca70-4d3d-ab45-671d027820e4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] <== disconnect_volume: return (358ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lazy-loading 'flavor' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a281569a-259b-4d02-84b7-236d47903da7 tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.830s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:37 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 885d9ddc-a084-472d-9422-5c93f549090d is timed out.
Dec 05 13:42:37 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully detached device vdb from instance 885d9ddc-a084-472d-9422-5c93f549090d from the live domain config.
Dec 05 13:42:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmnKOxBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdo'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:37 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2077b999-7636-4c2e-be21-a31d50153f4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:37 user nova-compute[75233]: No targets found.
Dec 05 13:42:37 user nova-compute[75233]: iSNS:
Dec 05 13:42:37 user nova-compute[75233]: No targets found.
Dec 05 13:42:37 user nova-compute[75233]: STATIC:
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59
Dec 05 13:42:37 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:37 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:37 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:37 user nova-compute[75233]: No targets found.
Dec 05 13:42:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:37 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:37 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17651c51-7833-4495-b215-ea46fe4fc270]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ab5cb6-8413-4d33-bc64-f07dd36e7be9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:37 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f600d1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59'): ({'sdo'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Removing single pathed devices sdo {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8969a6bc-6adc-439b-9285-344cb85f7d68]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdo {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdo" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe173ec-f547-4938-a98a-a24d79a4a1b3]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Flushing IO for device /dev/sdo {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdo {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdo" returned: 0 in 0.012s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a6009-c927-4f7b-b249-a09596d27d95]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdo/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdo/device/delete" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a35cdf-73b3-42fe-ad7f-a8023803cd7b]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Checking to see if SCSI volumes sdo have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] SCSI volumes sdo have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22844d68-47a0-4069-9462-8c1d1a1d357d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6ee05f-19f7-45d1-8d6d-2545a3c72233]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260]
Dec 05 13:42:38 user nova-compute[75233]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b1e6c6-8c53-45f3-be78-4c7ddc86f3e2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== disconnect_volume: return (315ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'flavor' on Instance uuid 885d9ddc-a084-472d-9422-5c93f549090d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-edd40431-74ef-4cb3-b071-f10325cfa6d6 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.533s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:38 user nova-compute[75233]: INFO nova.compute.manager [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Terminating instance
Dec 05 13:42:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-f54c0f1d-8e69-4367-95cd-300cdb2cfb4a req-24456876-4fa0-4b52-bed7-69d11bfad452 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-vif-unplugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f54c0f1d-8e69-4367-95cd-300cdb2cfb4a req-24456876-4fa0-4b52-bed7-69d11bfad452 service nova] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f54c0f1d-8e69-4367-95cd-300cdb2cfb4a req-24456876-4fa0-4b52-bed7-69d11bfad452 service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f54c0f1d-8e69-4367-95cd-300cdb2cfb4a req-24456876-4fa0-4b52-bed7-69d11bfad452 service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-f54c0f1d-8e69-4367-95cd-300cdb2cfb4a req-24456876-4fa0-4b52-bed7-69d11bfad452 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] No waiting events found dispatching network-vif-unplugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-f54c0f1d-8e69-4367-95cd-300cdb2cfb4a req-24456876-4fa0-4b52-bed7-69d11bfad452 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-vif-unplugged-a07ae192-8145-45ac-be9f-a7242a978e5d for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:39 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Instance destroyed successfully.
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'resources' on Instance uuid 885d9ddc-a084-472d-9422-5c93f549090d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2130072599',display_name='tempest-VolumesSnapshotTestJSON-instance-2130072599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2130072599',id=10,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrLXBiHjvHEaDghe78gdzYzSIVR1z3OrJVmAcpE1CZQEq9eYkr+OHicb6PvRCxUassmWbJpfnH5gzx56EpefNJF44ZOYPiCH563O/UDjYGpT7vvX9Dn1ZQ1XRyD6yMI3w==',key_name='tempest-keypair-852631441',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc0f5f6a8ad42c989c5900f97815384',ramdisk_id='',reservation_id='r-i4njd3x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1540026955',owner_user_name='tempest-VolumesSnapshotTestJSON-1540026955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e64aa1ef9e44d52a0587c6b009a1e9a',uuid=885d9ddc-a084-472d-9422-5c93f549090d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converting VIF {"id": "a07ae192-8145-45ac-be9f-a7242a978e5d", "address": "fa:16:3e:79:77:80", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07ae192-81", "ovs_interfaceid": "a07ae192-8145-45ac-be9f-a7242a978e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_vif [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa07ae192-81, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc2f7eee-4ede-4709-ad55-96497539bf33) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:39 user nova-compute[75233]: INFO os_vif [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:77:80,bridge_name='br-int',has_traffic_filtering=True,id=a07ae192-8145-45ac-be9f-a7242a978e5d,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07ae192-81')
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmnKOxBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdo'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:39 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c80ca-652b-4a59-8165-64fc5164c95a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:39 user nova-compute[75233]: No targets found.
Dec 05 13:42:39 user nova-compute[75233]: iSNS:
Dec 05 13:42:39 user nova-compute[75233]: No targets found.
Dec 05 13:42:39 user nova-compute[75233]: STATIC:
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:39 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:39 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:39 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:39 user nova-compute[75233]: No targets found.
Dec 05 13:42:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:39 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:39 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb2d3e7-22da-4e2f-b83e-61b88be70d59', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[78adaf93-7289-4114-8ca9-9d7560a5f520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ecb4fc-2d20-4560-b51a-6f266ad14eb2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:39 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582cf490>, {}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Disconnecting from: [] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.121s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== disconnect_volume: return (122ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:39 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Deleting instance files /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d_del
Dec 05 13:42:39 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Deletion of /opt/stack/data/nova/instances/885d9ddc-a084-472d-9422-5c93f549090d_del complete
Dec 05 13:42:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:40 user nova-compute[75233]: INFO nova.compute.manager [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Took 1.10 seconds to destroy the instance on the hypervisor.
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-changed-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing instance network info cache due to event network-changed-903392ae-faa6-42cc-aaaa-480aaf6f50e7. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] Acquiring lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] Acquired lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Refreshing network info cache for port 903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:40 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '885d9ddc-a084-472d-9422-5c93f549090d' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '885d9ddc-a084-472d-9422-5c93f549090d' (instance-0000000a)
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updated VIF entry in instance network info cache for port 903392ae-faa6-42cc-aaaa-480aaf6f50e7. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [{"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cac7b29d-4e8b-4d9f-a4db-e0f5e5a31a5b req-de02a64b-2aef-448e-b84b-2155f4dcced3 service nova] Releasing lock "refresh_cache-a1a6e098-df9b-4d80-b239-a5c3483b1e6f" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.objects.instance [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'flavor' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:41 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Took 1.59 seconds to deallocate network for instance.
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: WARNING nova.volume.cinder [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Attachment 1ad04bfa-e70b-48bf-9325-8048e11b5d58 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1ad04bfa-e70b-48bf-9325-8048e11b5d58. (HTTP 404) (Request-ID: req-1b95b6d1-28da-49c3-80a1-4293374b4c60)
Dec 05 13:42:41 user nova-compute[75233]: INFO nova.compute.manager [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Took 0.06 seconds to detach 1 volumes for instance.
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:41 user nova-compute[75233]: INFO nova.compute.manager [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Attaching volume 41ad45d8-0292-4962-82f2-9e815f7a9ab6 to /dev/vdb
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] Acquiring lock "885d9ddc-a084-472d-9422-5c93f549090d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] Lock "885d9ddc-a084-472d-9422-5c93f549090d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] No waiting events found dispatching network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:41 user nova-compute[75233]: WARNING nova.compute.manager [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received unexpected event network-vif-plugged-a07ae192-8145-45ac-be9f-a7242a978e5d for instance with vm_state deleted and task_state None.
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-changed-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing instance network info cache due to event network-changed-37916b1b-6c4a-458c-bb6e-c83241a127cc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] Acquiring lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] Acquired lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.network.neutron [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Refreshing network info cache for port 37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG os_brick.utils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[468778e4-dab5-4217-985a-9227e7f538b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68fe0d5-3408-47d2-9cd8-7e252a880976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17d239-6a60-4afb-b31a-7be4fadfbfac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae9746-0372-460f-852f-4c6a2817fca2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:42:41 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:42:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bdb46b-6073-4050-bd16-dc55e5186223]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG os_brick.utils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:41 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating existing volume attachment record: 2fbbb4c8-853a-494f-b5f4-de319bfb4ae7 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-c61cb4ec-61ff-4c53-94ec-4e8190b9c765 req-6f0b2ab2-43cb-41c0-b862-caa94f15ed61 service nova] [instance: 885d9ddc-a084-472d-9422-5c93f549090d] Received event network-vif-deleted-a07ae192-8145-45ac-be9f-a7242a978e5d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.657s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:42 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Deleted allocations for instance 885d9ddc-a084-472d-9422-5c93f549090d
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updated VIF entry in instance network info cache for port 37916b1b-6c4a-458c-bb6e-c83241a127cc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-facd491e-445c-494b-b7e2-9f95ebca235d tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "885d9ddc-a084-472d-9422-5c93f549090d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.698s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c2e6fe2-c73b-45a7-9d73-82efaa89bfd4 req-c324e173-0af6-42a4-8664-b0b11ddc868f service nova] Releasing lock "refresh_cache-edbd6067-bd46-4f66-a10d-a01e36efca03" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:43 user nova-compute[75233]: INFO nova.compute.manager [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Terminating instance
Dec 05 13:42:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:43 user nova-compute[75233]: INFO nova.compute.manager [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Terminating instance
Dec 05 13:42:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d8ec64-2876-4da8-931d-c91e2899e264 req-1f738e95-1594-4e49-beba-2b6666b15832 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d8ec64-2876-4da8-931d-c91e2899e264 req-1f738e95-1594-4e49-beba-2b6666b15832 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d8ec64-2876-4da8-931d-c91e2899e264 req-1f738e95-1594-4e49-beba-2b6666b15832 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d8ec64-2876-4da8-931d-c91e2899e264 req-1f738e95-1594-4e49-beba-2b6666b15832 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d8ec64-2876-4da8-931d-c91e2899e264 req-1f738e95-1594-4e49-beba-2b6666b15832 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d8ec64-2876-4da8-931d-c91e2899e264 req-1f738e95-1594-4e49-beba-2b6666b15832 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-11ea5a7d-87a0-40de-ae38-cee5c4691519 req-ecab8d39-83b3-4995-963f-c9ece212ee1a service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11ea5a7d-87a0-40de-ae38-cee5c4691519 req-ecab8d39-83b3-4995-963f-c9ece212ee1a service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11ea5a7d-87a0-40de-ae38-cee5c4691519 req-ecab8d39-83b3-4995-963f-c9ece212ee1a service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11ea5a7d-87a0-40de-ae38-cee5c4691519 req-ecab8d39-83b3-4995-963f-c9ece212ee1a service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-11ea5a7d-87a0-40de-ae38-cee5c4691519 req-ecab8d39-83b3-4995-963f-c9ece212ee1a service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-11ea5a7d-87a0-40de-ae38-cee5c4691519 req-ecab8d39-83b3-4995-963f-c9ece212ee1a service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-37916b1b-6c4a-458c-bb6e-c83241a127cc for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0974d7f-907e-41aa-adb2-5e5d16146b4a req-91138a1e-0c3e-4e17-ae1e-c6d666eb72a3 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0974d7f-907e-41aa-adb2-5e5d16146b4a req-91138a1e-0c3e-4e17-ae1e-c6d666eb72a3 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0974d7f-907e-41aa-adb2-5e5d16146b4a req-91138a1e-0c3e-4e17-ae1e-c6d666eb72a3 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0974d7f-907e-41aa-adb2-5e5d16146b4a req-91138a1e-0c3e-4e17-ae1e-c6d666eb72a3 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0974d7f-907e-41aa-adb2-5e5d16146b4a req-91138a1e-0c3e-4e17-ae1e-c6d666eb72a3 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0974d7f-907e-41aa-adb2-5e5d16146b4a req-91138a1e-0c3e-4e17-ae1e-c6d666eb72a3 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-3f0aba05-78aa-4a57-8dcb-078fce6c7784 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-903392ae-faa6-42cc-aaaa-480aaf6f50e7 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-8d6f979e-da10-4cc9-afc3-eb3f47b9c4f8 req-b3d5b64b-cc86-4613-94ce-b932594129ba service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-d3dc4614-6e00-4a6a-9db8-d436f984d9a7 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: INFO nova.compute.manager [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Terminating instance
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Instance destroyed successfully.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lazy-loading 'resources' on Instance uuid edbd6067-bd46-4f66-a10d-a01e36efca03 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Instance destroyed successfully.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lazy-loading 'resources' on Instance uuid a1a6e098-df9b-4d80-b239-a5c3483b1e6f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7265MB free_disk=25.22857666015625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "address": "fa:16:3e:c7:3d:47", "network": {"id": "b60f0290-834e-47bb-8e38-47c04c75eda8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1097531166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903392ae-fa", "ovs_interfaceid": "903392ae-faa6-42cc-aaaa-480aaf6f50e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37916b1b-6c, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-37916b1b-6c4a-458c-bb6e-c83241a127cc for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-483a3a1b-0fdb-4a8f-97ca-16628a74672d for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-97faf99e-f277-44f6-8ecb-dabef4c582b4 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b2d4855-3fed-4c03-be84-574f288e7163 req-e7279875-d76a-4391-ac01-2401aaded9c8 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 63978594-a36a-47f8-a596-4e6c1b965e7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 61b72e12-781d-472c-841d-59cacd38578f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 82f774ff-049f-4504-9fd0-b526079a13d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a1a6e098-df9b-4d80-b239-a5c3483b1e6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance edbd6067-bd46-4f66-a10d-a01e36efca03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ea52330e-ed18-4c84-bd28-ca464c968ebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-08d1661e-06b3-4562-80fe-4b8fb15950a9 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-ac01118f-15bc-4182-af5f-73349fb26b3f for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-ac01118f-15bc-4182-af5f-73349fb26b3f for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-unplugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-unplugged-41f728b9-8d5c-4809-b371-67153855343c for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] No waiting events found dispatching network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received unexpected event network-vif-plugged-41f728b9-8d5c-4809-b371-67153855343c for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:46 user nova-compute[75233]: WARNING nova.compute.manager [req-e4d3f522-128b-4a6d-a006-4ee75a745b17 req-385b30b3-7326-45fa-a1a4-a9d5cc3dfcb2 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-61f4b0a9-95e0-4752-97ba-47f8f5359e15 for instance with vm_state active and task_state deleting.
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903392ae-fa, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=190e42cd-12a3-4946-9d99-0aa908108b3b) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.964s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:47 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Instance destroyed successfully.
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.objects.instance [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lazy-loading 'resources' on Instance uuid 82f774ff-049f-4504-9fd0-b526079a13d5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1228387339',display_name='tempest-VolumesAssistedSnapshotsTest-server-1228387339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1228387339',id=8,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2PEedseFCDjuv3FXKWwYDgAIc0J1Oy+sUPNsGDUZEJvCTtJ8OXZV87uprPQpK8lWRpmIrfHPAucCWQbQWvOyLU3SQ8rmN/9T4Tb9OEY5q8ius+DQ5kFcWPl92C10TITQ==',key_name='tempest-keypair-2147439686',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73ef1cc1000f47e38c59a4e503709890',ramdisk_id='',reservation_id='r-q0zgni02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1865583520',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1865583520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='416a535a8f2c47d38ddb6a62f00b1874',uuid=82f774ff-049f-4504-9fd0-b526079a13d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Converting VIF {"id": "184f8015-da2f-409e-832c-09c3c81a1e7e", "address": "fa:16:3e:9f:ae:88", "network": {"id": "ee169d84-2b36-48a6-9fbd-6094f4e6be3c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1878690543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73ef1cc1000f47e38c59a4e503709890", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184f8015-da", "ovs_interfaceid": "184f8015-da2f-409e-832c-09c3c81a1e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG os_vif [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d8d5346-429d-4a53-b50f-c23e90f8cf77) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=37916b1b-6c4a-458c-bb6e-c83241a127cc,network=Network(b69bda67-816c-41cb-b242-7102d99eb4ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37916b1b-6c')
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap184f8015-da, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:47 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:3d:47,bridge_name='br-int',has_traffic_filtering=True,id=903392ae-faa6-42cc-aaaa-480aaf6f50e7,network=Network(b60f0290-834e-47bb-8e38-47c04c75eda8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903392ae-fa')
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f0aba05-78, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac01118f-15, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-7061c9ce-8024-4f64-9572-a363bb470f95 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: WARNING nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-7061c9ce-8024-4f64-9572-a363bb470f95 for instance with vm_state active and task_state deleting.
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-vif-unplugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] No waiting events found dispatching network-vif-unplugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-vif-unplugged-184f8015-da2f-409e-832c-09c3c81a1e7e for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Acquiring lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] Lock "82f774ff-049f-4504-9fd0-b526079a13d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] No waiting events found dispatching network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: WARNING nova.compute.manager [req-11e71292-4bc9-4fca-91d9-4ceedb5fe790 req-53c01637-069c-4956-954b-7efb52e2609d service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received unexpected event network-vif-plugged-184f8015-da2f-409e-832c-09c3c81a1e7e for instance with vm_state active and task_state deleting.
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c1380cf-34e6-4f4e-8c4c-c41b7e560a40) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a4880aa-f345-42b4-a345-372f2fff16c5) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: INFO os_vif [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ae:88,bridge_name='br-int',has_traffic_filtering=True,id=184f8015-da2f-409e-832c-09c3c81a1e7e,network=Network(ee169d84-2b36-48a6-9fbd-6094f4e6be3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184f8015-da')
Dec 05 13:42:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Deleting instance files /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5_del
Dec 05 13:42:48 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Deletion of /opt/stack/data/nova/instances/82f774ff-049f-4504-9fd0-b526079a13d5_del complete
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:42:48 user nova-compute[75233]: INFO nova.compute.manager [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Took 1.99 seconds to destroy the instance on the hypervisor.
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb978339-d92f-4709-bd15-e29bb9d90aa6) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a5:03,bridge_name='br-int',has_traffic_filtering=True,id=ac01118f-15bc-4182-af5f-73349fb26b3f,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac01118f-15')
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61f4b0a9-95, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ed:ed,bridge_name='br-int',has_traffic_filtering=True,id=3f0aba05-78aa-4a57-8dcb-078fce6c7784,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f0aba05-78')
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3dc4614-6e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: WARNING nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 for instance with vm_state active and task_state deleting.
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-unplugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-unplugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Acquiring lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] No waiting events found dispatching network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:48 user nova-compute[75233]: WARNING nova.compute.manager [req-1792fe83-beb1-46f1-99f2-64d4d007fb54 req-7098e515-d85c-40d2-a03f-b4c54f7db639 service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received unexpected event network-vif-plugged-fb1a68ef-58d9-48f4-a82d-6e7756b34818 for instance with vm_state active and task_state deleting.
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=702c5f27-5b87-4a28-81be-9c2f126d61bd) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=816b7c8e-e151-4a27-b9e6-2dac52042d74) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:7d,bridge_name='br-int',has_traffic_filtering=True,id=61f4b0a9-95e0-4752-97ba-47f8f5359e15,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61f4b0a9-95')
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5e8ae9b-9e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:41:e7,bridge_name='br-int',has_traffic_filtering=True,id=d3dc4614-6e00-4a6a-9db8-d436f984d9a7,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd3dc4614-6e')
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41f728b9-8d, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=444a4804-5685-4c9e-9a0c-a10e0295e5b8) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updating instance_info_cache with network_info: [{"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed2fd019-4c5f-4d9a-81f5-acc60fbaf89f) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:48 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:57:8b,bridge_name='br-int',has_traffic_filtering=True,id=d5e8ae9b-9ee1-49d7-8bde-ef03158829c9,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e8ae9b-9e')
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-63978594-a36a-47f8-a596-4e6c1b965e7c" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:42:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap483a3a1b-0f, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8f:66,bridge_name='br-int',has_traffic_filtering=True,id=41f728b9-8d5c-4809-b371-67153855343c,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41f728b9-8d')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08d1661e-06, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d97b423a-44da-4c39-bfab-e13ce316a9e6) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Took 0.86 seconds to deallocate network for instance.
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fd37704-758b-4ac0-84ea-6c8bed9ee578) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:a0,bridge_name='br-int',has_traffic_filtering=True,id=483a3a1b-0fdb-4a8f-97ca-16628a74672d,network=Network(c7234bad-34c5-4287-b0ee-328b5bf36365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483a3a1b-0f')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7061c9ce-80, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:e9:34,bridge_name='br-int',has_traffic_filtering=True,id=08d1661e-06b3-4562-80fe-4b8fb15950a9,network=Network(383bf0b9-2562-46fe-9672-22a0c10639e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d1661e-06')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fa00b5d-73, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95a28c63-38a5-49ae-ae5c-fc4fc23511f2) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=445d2add-4250-4ca2-a116-1c697351027f) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ea:b8,bridge_name='br-int',has_traffic_filtering=True,id=7061c9ce-8024-4f64-9572-a363bb470f95,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7061c9ce-80')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732013876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732013876',id=11,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3Cty6AqyUXRLYX+qaTZr6y2Pm+Yv8vaX7ce8KaZsvMgEd/Du3T0Zf2GIhL7RZvzIZq9Wdwm6W6ysMy+dbdUWayRvESPU1WC7UvvNmiEw1g1/M7dhhFYPXBgCZpAVAhA==',key_name='tempest-keypair-1673402696',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b9175eaa564bc08df6a8f358865fee',ramdisk_id='',reservation_id='r-yz72q3rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-290263566',owner_user_name='tempest-TaggedBootDevicesTest_v242-290263566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3f1614c6f8b49c48d6fc69b2133c600',uuid=a1a6e098-df9b-4d80-b239-a5c3483b1e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converting VIF {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb1a68ef-58, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:7d,bridge_name='br-int',has_traffic_filtering=True,id=5fa00b5d-73c6-4493-9cb4-d4ae97598d51,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa00b5d-73')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1232982107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1232982107',id=12,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT2XQxITkjRYrPYXOVCXGs5bRrJynC/9QSXEdSuUPQXF7t/iOspLq91zGFVZH5OQuGnhMQiYCDLbjUBWVWU8sTkAIJMfS/ZQlktcjjpaD4jCqtQ1zVAz7X1cZtVwOxhHQ==',key_name='tempest-keypair-1434130897',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46ab2194e480431abd2d2e27aa394177',ramdisk_id='',reservation_id='r-hd0nfclx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-886833816',owner_user_name='tempest-TaggedBootDevicesTest-886833816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2069f5a667407ea5b92c2f605af2a3',uuid=edbd6067-bd46-4f66-a10d-a01e36efca03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converting VIF {"id": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "address": "fa:16:3e:e6:bd:75", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97faf99e-f2", "ovs_interfaceid": "97faf99e-f277-44f6-8ecb-dabef4c582b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97faf99e-f2, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eaa79c7a-14cf-4c6c-9339-2756d7159482) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7894ebcb-2b3e-4746-bf7f-f86a09fad0bb) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0e:cd,bridge_name='br-int',has_traffic_filtering=True,id=fb1a68ef-58d9-48f4-a82d-6e7756b34818,network=Network(62aec22c-0492-448a-90f2-2e238b9e86a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb1a68ef-58')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isNfaOoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:49 user nova-compute[75233]: INFO os_vif [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:bd:75,bridge_name='br-int',has_traffic_filtering=True,id=97faf99e-f277-44f6-8ecb-dabef4c582b4,network=Network(95c62135-1116-46b2-b924-d30adf3f6692),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97faf99e-f2')
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzjTpDho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99791f6-bd03-47d6-8b90-486f85ed4e67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:49 user nova-compute[75233]: No targets found.
Dec 05 13:42:49 user nova-compute[75233]: iSNS:
Dec 05 13:42:49 user nova-compute[75233]: No targets found.
Dec 05 13:42:49 user nova-compute[75233]: STATIC:
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:49 user nova-compute[75233]: No targets found.
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:49 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:49 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4ede72-2dad-4bc8-a122-fa8822d88b65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2a7280-7350-4d8d-a60d-87cb22732a57]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34742050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e157c6d-2123-46ee-b5c9-c625984df4fd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[beff5839-654a-4835-bb04-1fda876d8626]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca59609-32e2-453e-8bba-23ff32bc6aec]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd3736-9fcb-40e2-9a23-2c6bddad2438]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a4c113-658c-43a0-a549-8a81ea0516c1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:49 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Deleted allocations for instance 82f774ff-049f-4504-9fd0-b526079a13d5
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7955e36-1a09-406e-865d-4bbe69d002a8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260]
Dec 05 13:42:49 user nova-compute[75233]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5399c35-f7eb-4e16-96c6-47a0f3329769 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4924f2-6284-4953-86fa-8315664d8c42]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== disconnect_volume: return (389ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.383s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtsMQvcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b34a7bb-97f0-4b70-a2ba-890a71345d09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:49 user nova-compute[75233]: No targets found.
Dec 05 13:42:49 user nova-compute[75233]: iSNS:
Dec 05 13:42:49 user nova-compute[75233]: No targets found.
Dec 05 13:42:49 user nova-compute[75233]: STATIC:
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:49 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:49 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:49 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:49 user nova-compute[75233]: No targets found.
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:49 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:49 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[921deea4-448d-452c-8ac7-792429535f7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-883605ee-9ce1-4b8f-b011-6e7dcb3a4ee1 tempest-VolumesAssistedSnapshotsTest-1865583520 tempest-VolumesAssistedSnapshotsTest-1865583520-project-member] Lock "82f774ff-049f-4504-9fd0-b526079a13d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.589s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb4cd3-01e0-4e8f-9f3c-7311773a4db2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:49 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f616dfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a78854f-6596-4ffd-9215-8cb30327d8f5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f86a6b6-f9fe-4194-b726-96565635638e]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4831e908-9775-4105-ba9b-dbe1f3674709]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a844d-0e27-4fed-a368-c037be2b7eff]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df92ce-f8de-4c76-8e60-b08df092308a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[370ffeca-17f8-4f70-b53a-231f97774b4c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260]
Dec 05 13:42:50 user nova-compute[75233]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d958bdc4-575a-487d-9ce9-ba02c3e403cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a376df-d982-417d-a671-56ebd0b38794]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== disconnect_volume: return (727ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.342s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBjLNsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:50 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e884d74-9d9f-46cc-ba30-2261b1987c2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]: iSNS:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]: STATIC:
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:50 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:50 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81600171-e643-4f7e-8f30-4671f7d94899]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7585c8-8d33-4ce6-a1e5-c00fa3a6ce5e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f58701990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460'): ({'sde'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Removing single pathed devices sde {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[29567750-9a44-4770-ac2c-00f70b539d32]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7e3c2-a36f-4671-8679-117f71365e13]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Flushing IO for device /dev/sde {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ebc602-e6a1-4779-a54e-8bd6bb08c5ec]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4333ce6-449e-44ec-985a-2a2b2bf69512]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547ce3b-0acf-4301-887a-cbd1b516d2cb]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6649fa69-a9c8-49ce-a23c-35ef24646119]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260]
Dec 05 13:42:50 user nova-compute[75233]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f43d22f-52a4-4415-8793-2434aec5d460 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe03750-63b8-4f9f-b6dc-ffb861f582e5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== disconnect_volume: return (679ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.335s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjefnkIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:50 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1384b-8760-492f-ad3b-028da6570003]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]: iSNS:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]: STATIC:
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:50 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:50 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa4e02f-4040-45cd-a2c3-18cf0aa5d7b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec84a5f-3f7d-406b-8638-a964d18643d5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f58701990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854'): ({'sdf'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Removing single pathed devices sdf {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f229d36-cc91-4e7d-92cf-c6845c7f3394]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f8e32e7-9a43-41e5-88a5-61beebf6ced3 req-5bc544ad-63b8-4e2c-9e42-e4b38a91c95c service nova] [instance: 82f774ff-049f-4504-9fd0-b526079a13d5] Received event network-vif-deleted-184f8015-da2f-409e-832c-09c3c81a1e7e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ac9804-272e-4bea-a01c-60e09d68d219]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Flushing IO for device /dev/sdf {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fa8b2-ac76-4627-b4a2-fd835ca2aa21]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4022fbb-ad5e-46de-9337-440ee2400385]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e84145e-0ed9-43e2-8b8e-debb1ba25350]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[163adc76-4f7d-464b-89e5-58f765132665]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260]
Dec 05 13:42:50 user nova-compute[75233]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18495a8b-3eb7-4b11-b971-c6860b5bf854 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f0089-2001-45e4-a892-0420e9130056]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== disconnect_volume: return (739ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.402s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHDsIfcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:50 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95502381-cca6-40dd-9368-2de3e6ca1f36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]: iSNS:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]: STATIC:
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a
Dec 05 13:42:50 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:50 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:50 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:50 user nova-compute[75233]: No targets found.
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:50 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:50 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5779309-264e-4060-b1d1-bf0c00c6fbf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699cb64-2b9b-40b6-b527-31d9149251df]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a (non-flash)
Dec 05 13:42:50 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34776cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a'): ({'sdg'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Removing single pathed devices sdg {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c28ee-3383-46b2-aa56-e3e284c78215]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000f6ae-e603-4a11-b4c6-8bceed166196]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Flushing IO for device /dev/sdg {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e98811-210a-4819-b501-ad1b2f21fa34]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff39892-7aaa-49c1-94ea-f115542b45ce]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] SCSI volumes sdg have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9758e5da-2fd7-4497-b2cf-af425b7bcc1e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[221756cb-676d-4a47-ab0a-02e931295b44]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260]
Dec 05 13:42:51 user nova-compute[75233]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf704330-c22b-4921-9338-0e30467d551a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17bda2-9c39-4132-9fc9-ce002ad7cd4a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] <== disconnect_volume: return (724ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Deleting instance files /opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f_del
Dec 05 13:42:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Deletion of /opt/stack/data/nova/instances/a1a6e098-df9b-4d80-b239-a5c3483b1e6f_del complete
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.328s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9601b512-7b5e-4edb-a6ae-7a51683f67f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:42:51 user nova-compute[75233]: No targets found.
Dec 05 13:42:51 user nova-compute[75233]: iSNS:
Dec 05 13:42:51 user nova-compute[75233]: No targets found.
Dec 05 13:42:51 user nova-compute[75233]: STATIC:
Dec 05 13:42:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33
Dec 05 13:42:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:42:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:42:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:42:51 user nova-compute[75233]: FIRMWARE:
Dec 05 13:42:51 user nova-compute[75233]: No targets found.
Dec 05 13:42:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:42:51 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:42:51 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d89a8a-7e87-400b-830c-c556d62ca4b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: INFO nova.compute.manager [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Took 7.78 seconds to destroy the instance on the hypervisor.
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e9700-09de-4cb8-ba2c-f63b8bc961b8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:51 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:51 user nova-compute[75233]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 (non-flash)
Dec 05 13:42:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582cdc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33'): ({'sdh'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Removing single pathed devices sdh {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bdbb3-f526-45a6-ba53-459dc2ae44f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c5c5b-d918-4070-a470-1c2f2632e0f1]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Flushing IO for device /dev/sdh {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[378accf5-2319-41b7-ad1c-ba5cc37114a7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8c69e0-6e74-4fda-8669-6433d337595c]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] SCSI volumes sdh have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a198b9a5-266e-436e-9656-838a2fb5acc4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ab387-dad5-4808-963f-b7ac83e0d48b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260]
Dec 05 13:42:51 user nova-compute[75233]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af942720-f286-43e3-aac7-6f8bc76bda33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e4a1b8-fd5e-4cd2-bae9-806bee6f7bbf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] <== disconnect_volume: return (632ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:42:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Deleting instance files /opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03_del
Dec 05 13:42:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Deletion of /opt/stack/data/nova/instances/edbd6067-bd46-4f66-a10d-a01e36efca03_del complete
Dec 05 13:42:51 user nova-compute[75233]: INFO nova.compute.manager [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Took 8.34 seconds to destroy the instance on the hypervisor.
Dec 05 13:42:51 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:42:51 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JenvmMyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:42:54 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:54 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:42:54 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a63932-fa94-4753-8e66-ce62062252d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:42:54 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-587ec6b4-a096-4364-84f7-8f77073b7712 req-63e5a716-2bf2-458e-9a46-b505b0c03584 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-deleted-97faf99e-f277-44f6-8ecb-dabef4c582b4 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:54 user nova-compute[75233]: INFO nova.compute.manager [req-587ec6b4-a096-4364-84f7-8f77073b7712 req-63e5a716-2bf2-458e-9a46-b505b0c03584 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Neutron deleted interface 97faf99e-f277-44f6-8ecb-dabef4c582b4; detaching it from the instance and deleting it from the info cache
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.network.neutron [req-587ec6b4-a096-4364-84f7-8f77073b7712 req-63e5a716-2bf2-458e-9a46-b505b0c03584 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "address": "fa:16:3e:76:d2:ae", "network": {"id": "b69bda67-816c-41cb-b242-7102d99eb4ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-107625592-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37916b1b-6c", "ovs_interfaceid": "37916b1b-6c4a-458c-bb6e-c83241a127cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[40596f74-aa5c-4328-b2da-1277554e9da6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6] added
Dec 05 13:42:54 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-587ec6b4-a096-4364-84f7-8f77073b7712 req-63e5a716-2bf2-458e-9a46-b505b0c03584 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Detach interface failed, port_id=97faf99e-f277-44f6-8ecb-dabef4c582b4, reason: Instance edbd6067-bd46-4f66-a10d-a01e36efca03 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec8018-0282-440f-aa5a-38ec26f9710b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[213072d1-5e72-4385-9dcf-e5351a24bfe1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JenvmMyw {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-ff483563-afcd-46ca-a239-c6e2550d239e req-40939e4b-3476-478a-a83c-d56892c4ae5f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-deleted-903392ae-faa6-42cc-aaaa-480aaf6f50e7 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:54 user nova-compute[75233]: INFO nova.compute.manager [req-ff483563-afcd-46ca-a239-c6e2550d239e req-40939e4b-3476-478a-a83c-d56892c4ae5f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Neutron deleted interface 903392ae-faa6-42cc-aaaa-480aaf6f50e7; detaching it from the instance and deleting it from the info cache
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.network.neutron [req-ff483563-afcd-46ca-a239-c6e2550d239e req-40939e4b-3476-478a-a83c-d56892c4ae5f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [{"id": "ac01118f-15bc-4182-af5f-73349fb26b3f", "address": "fa:16:3e:8a:a5:03", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac01118f-15", "ovs_interfaceid": "ac01118f-15bc-4182-af5f-73349fb26b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "address": "fa:16:3e:68:b6:7d", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f4b0a9-95", "ovs_interfaceid": "61f4b0a9-95e0-4752-97ba-47f8f5359e15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "address": "fa:16:3e:9c:57:8b", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e8ae9b-9e", "ovs_interfaceid": "d5e8ae9b-9ee1-49d7-8bde-ef03158829c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "address": "fa:16:3e:ae:2d:a0", "network": {"id": "c7234bad-34c5-4287-b0ee-328b5bf36365", "bridge": "br-int", "label": "tempest-device-tagging-net1-1556352070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483a3a1b-0f", "ovs_interfaceid": "483a3a1b-0fdb-4a8f-97ca-16628a74672d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7061c9ce-8024-4f64-9572-a363bb470f95", "address": "fa:16:3e:02:ea:b8", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7061c9ce-80", "ovs_interfaceid": "7061c9ce-8024-4f64-9572-a363bb470f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "address": "fa:16:3e:be:0e:cd", "network": {"id": "62aec22c-0492-448a-90f2-2e238b9e86a5", "bridge": "br-int", "label": "tempest-device-tagging-net2-637279893", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "57b9175eaa564bc08df6a8f358865fee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb1a68ef-58", "ovs_interfaceid": "fb1a68ef-58d9-48f4-a82d-6e7756b34818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JenvmMyw" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac31e8-14f4-4247-b3e9-f38cbcce2d6b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JenvmMyw'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d6accb-5b3d-41ea-9fc4-e34b0ec55e1f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-ff483563-afcd-46ca-a239-c6e2550d239e req-40939e4b-3476-478a-a83c-d56892c4ae5f service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Detach interface failed, port_id=903392ae-faa6-42cc-aaaa-480aaf6f50e7, reason: Instance a1a6e098-df9b-4d80-b239-a5c3483b1e6f could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4dce69-ff55-4cfb-aa99-0d64ccae0cf2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:54 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:54 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3774bb3-5273-4ffa-86c6-3fe0d7b37934]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260]
Dec 05 13:42:54 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260] successful.
Dec 05 13:42:54 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e88731-2f9a-44e9-a066-eabef533f830]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8418fd-2e83-4069-8c6d-11ebc9a672cd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:54 user nova-compute[75233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:42:54 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:42:54 user nova-compute[75233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:42:54 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[88257219-05b8-4c44-aaf8-42c56db19163]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JenvmMyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23762346365633938', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762346365633938', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG nova.objects.instance [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'flavor' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:42:55 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:42:55 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:42:55 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:42:55 user nova-compute[75233]:   <serial>41ad45d8-0292-4962-82f2-9e815f7a9ab6</serial>
Dec 05 13:42:55 user nova-compute[75233]: </disk>
Dec 05 13:42:55 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:42:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No VIF found with MAC fa:16:3e:b2:7c:53, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9f23d35a-bb75-497a-860e-93e7dfa4fb99 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.261s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:56 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Took 4.89 seconds to deallocate network for instance.
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-3ac0a358-2757-4012-9335-357043559fef req-23331c0c-b82f-496a-8c43-d6aa456392ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-deleted-d5e8ae9b-9ee1-49d7-8bde-ef03158829c9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-3ac0a358-2757-4012-9335-357043559fef req-23331c0c-b82f-496a-8c43-d6aa456392ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-deleted-7061c9ce-8024-4f64-9572-a363bb470f95 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-3ac0a358-2757-4012-9335-357043559fef req-23331c0c-b82f-496a-8c43-d6aa456392ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-deleted-fb1a68ef-58d9-48f4-a82d-6e7756b34818 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-3ac0a358-2757-4012-9335-357043559fef req-23331c0c-b82f-496a-8c43-d6aa456392ba service nova] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Received event network-vif-deleted-483a3a1b-0fdb-4a8f-97ca-16628a74672d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-deleted-37916b1b-6c4a-458c-bb6e-c83241a127cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: INFO nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Neutron deleted interface 37916b1b-6c4a-458c-bb6e-c83241a127cc; detaching it from the instance and deleting it from the info cache
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.network.neutron [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41f728b9-8d5c-4809-b371-67153855343c", "address": "fa:16:3e:d8:8f:66", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41f728b9-8d", "ovs_interfaceid": "41f728b9-8d5c-4809-b371-67153855343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Detach interface failed, port_id=37916b1b-6c4a-458c-bb6e-c83241a127cc, reason: Instance edbd6067-bd46-4f66-a10d-a01e36efca03 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-deleted-41f728b9-8d5c-4809-b371-67153855343c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: INFO nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Neutron deleted interface 41f728b9-8d5c-4809-b371-67153855343c; detaching it from the instance and deleting it from the info cache
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.network.neutron [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "address": "fa:16:3e:13:e9:34", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d1661e-06", "ovs_interfaceid": "08d1661e-06b3-4562-80fe-4b8fb15950a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Detach interface failed, port_id=41f728b9-8d5c-4809-b371-67153855343c, reason: Instance edbd6067-bd46-4f66-a10d-a01e36efca03 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-deleted-08d1661e-06b3-4562-80fe-4b8fb15950a9 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:56 user nova-compute[75233]: INFO nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Neutron deleted interface 08d1661e-06b3-4562-80fe-4b8fb15950a9; detaching it from the instance and deleting it from the info cache
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.network.neutron [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [{"id": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "address": "fa:16:3e:bc:ed:ed", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f0aba05-78", "ovs_interfaceid": "3f0aba05-78aa-4a57-8dcb-078fce6c7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "address": "fa:16:3e:e6:41:e7", "network": {"id": "383bf0b9-2562-46fe-9672-22a0c10639e2", "bridge": "br-int", "label": "tempest-device-tagging-net1-646539861", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc4614-6e", "ovs_interfaceid": "d3dc4614-6e00-4a6a-9db8-d436f984d9a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "address": "fa:16:3e:79:72:7d", "network": {"id": "95c62135-1116-46b2-b924-d30adf3f6692", "bridge": "br-int", "label": "tempest-device-tagging-net2-1694581395", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46ab2194e480431abd2d2e27aa394177", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa00b5d-73", "ovs_interfaceid": "5fa00b5d-73c6-4493-9cb4-d4ae97598d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-5bdb07b3-8289-4b8d-a738-f325270c259f req-483e47c7-6ee6-4550-a6a9-ffe284ce8550 service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Detach interface failed, port_id=08d1661e-06b3-4562-80fe-4b8fb15950a9, reason: Instance edbd6067-bd46-4f66-a10d-a01e36efca03 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:42:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:56 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Took 5.31 seconds to deallocate network for instance.
Dec 05 13:42:57 user nova-compute[75233]: INFO nova.compute.manager [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Rescuing
Dec 05 13:42:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:42:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:42:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:58 user nova-compute[75233]: INFO nova.compute.manager [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Terminating instance
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-292a8084-6aef-48e3-9192-5b3a9c262ec1 req-2fab9bc6-6d6b-4570-af9b-8f0411423001 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-unplugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-292a8084-6aef-48e3-9192-5b3a9c262ec1 req-2fab9bc6-6d6b-4570-af9b-8f0411423001 service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-292a8084-6aef-48e3-9192-5b3a9c262ec1 req-2fab9bc6-6d6b-4570-af9b-8f0411423001 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-292a8084-6aef-48e3-9192-5b3a9c262ec1 req-2fab9bc6-6d6b-4570-af9b-8f0411423001 service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-292a8084-6aef-48e3-9192-5b3a9c262ec1 req-2fab9bc6-6d6b-4570-af9b-8f0411423001 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-unplugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-292a8084-6aef-48e3-9192-5b3a9c262ec1 req-2fab9bc6-6d6b-4570-af9b-8f0411423001 service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-unplugged-1ad882c8-81f9-48ed-a978-734805dd9564 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-d9cdf2dd-352e-41cd-bb22-38f07829e170 req-9163cf0d-61c5-48c5-9799-55108938104e service nova] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Received event network-vif-deleted-5fa00b5d-73c6-4493-9cb4-d4ae97598d51 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-46d517a3-97e7-4a2f-8cd1-7e0bc271be44 req-59a4e504-28fd-4d5d-b9e8-b4ef8db7976d service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-46d517a3-97e7-4a2f-8cd1-7e0bc271be44 req-59a4e504-28fd-4d5d-b9e8-b4ef8db7976d service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-46d517a3-97e7-4a2f-8cd1-7e0bc271be44 req-59a4e504-28fd-4d5d-b9e8-b4ef8db7976d service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-46d517a3-97e7-4a2f-8cd1-7e0bc271be44 req-59a4e504-28fd-4d5d-b9e8-b4ef8db7976d service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-46d517a3-97e7-4a2f-8cd1-7e0bc271be44 req-59a4e504-28fd-4d5d-b9e8-b4ef8db7976d service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:42:58 user nova-compute[75233]: WARNING nova.compute.manager [req-46d517a3-97e7-4a2f-8cd1-7e0bc271be44 req-59a4e504-28fd-4d5d-b9e8-b4ef8db7976d service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state rescuing.
Dec 05 13:42:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.compute.manager [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] [instance: a1a6e098-df9b-4d80-b239-a5c3483b1e6f] Took 2.86 seconds to detach 3 volumes for instance.
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Instance destroyed successfully.
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lazy-loading 'resources' on Instance uuid cf62dc1b-8a7e-48ac-88e7-420ce6b9851c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance destroyed successfully.
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Attempting a stable device rescue
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T13:39:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1944126899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1944126899',id=7,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr3pJm7vskjmSTTcpLIy12ncNm4bb6fYIDdQPvBVhmxUkC7vkLEY2HEJmwqewTf+QUYKhmXxt90XTEhouA7cEPoQkaji/V8ZrRtuV0JXhtHB3Tjs9iNWdjwyaOnFUX1YA==',key_name='tempest-keypair-1188514866',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f74e2293c74d82b37d4bdd6c9db8b1',ramdisk_id='',reservation_id='r-mb9uegcl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-930674786',owner_user_name='tempest-TaggedAttachmentsTest-930674786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7c7ad4b6e3420eb9b1458993a83420',uuid=cf62dc1b-8a7e-48ac-88e7-420ce6b9851c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converting VIF {"id": "1ad882c8-81f9-48ed-a978-734805dd9564", "address": "fa:16:3e:73:8c:03", "network": {"id": "2286c5b8-64ef-406b-af38-eab03c7c65a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1916857787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f74e2293c74d82b37d4bdd6c9db8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad882c8-81", "ovs_interfaceid": "1ad882c8-81f9-48ed-a978-734805dd9564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG os_vif [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad882c8-81, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9511efd-fa11-4e84-99ab-fa0f328f7f59) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:42:59 user nova-compute[75233]: INFO os_vif [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:8c:03,bridge_name='br-int',has_traffic_filtering=True,id=1ad882c8-81f9-48ed-a978-734805dd9564,network=Network(2286c5b8-64ef-406b-af38-eab03c7c65a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad882c8-81')
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Deleting instance files /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c_del
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Deletion of /opt/stack/data/nova/instances/cf62dc1b-8a7e-48ac-88e7-420ce6b9851c_del complete
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Creating image(s)
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'trusted_certs' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "369bead66d7979431fdd95be2117d41784533eb0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "369bead66d7979431fdd95be2117d41784533eb0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.compute.manager [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Took 1.43 seconds to destroy the instance on the hypervisor.
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Deleted allocations for instance a1a6e098-df9b-4d80-b239-a5c3483b1e6f
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1d8daf9e-424b-43bf-ab1a-dc0c8cd5ee07 tempest-TaggedBootDevicesTest_v242-290263566 tempest-TaggedBootDevicesTest_v242-290263566-project-member] Lock "a1a6e098-df9b-4d80-b239-a5c3483b1e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.331s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:42:59 user nova-compute[75233]: INFO nova.compute.manager [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] [instance: edbd6067-bd46-4f66-a10d-a01e36efca03] Took 2.96 seconds to detach 3 volumes for instance.
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:42:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-ba736593-9df8-484c-a5e8-9ac8a290c50e req-f1b391bf-fcf4-49a6-b74f-96d0ac4c04ce service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ba736593-9df8-484c-a5e8-9ac8a290c50e req-f1b391bf-fcf4-49a6-b74f-96d0ac4c04ce service nova] Acquiring lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ba736593-9df8-484c-a5e8-9ac8a290c50e req-f1b391bf-fcf4-49a6-b74f-96d0ac4c04ce service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ba736593-9df8-484c-a5e8-9ac8a290c50e req-f1b391bf-fcf4-49a6-b74f-96d0ac4c04ce service nova] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-ba736593-9df8-484c-a5e8-9ac8a290c50e req-f1b391bf-fcf4-49a6-b74f-96d0ac4c04ce service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] No waiting events found dispatching network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:00 user nova-compute[75233]: WARNING nova.compute.manager [req-ba736593-9df8-484c-a5e8-9ac8a290c50e req-f1b391bf-fcf4-49a6-b74f-96d0ac4c04ce service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received unexpected event network-vif-plugged-1ad882c8-81f9-48ed-a978-734805dd9564 for instance with vm_state active and task_state deleting.
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-c689a2d2-f48e-43eb-8fbf-b6ccd42d334e req-9b4f120f-671f-4852-b132-87e1749cc2e9 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c689a2d2-f48e-43eb-8fbf-b6ccd42d334e req-9b4f120f-671f-4852-b132-87e1749cc2e9 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c689a2d2-f48e-43eb-8fbf-b6ccd42d334e req-9b4f120f-671f-4852-b132-87e1749cc2e9 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c689a2d2-f48e-43eb-8fbf-b6ccd42d334e req-9b4f120f-671f-4852-b132-87e1749cc2e9 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-c689a2d2-f48e-43eb-8fbf-b6ccd42d334e req-9b4f120f-671f-4852-b132-87e1749cc2e9 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:01 user nova-compute[75233]: WARNING nova.compute.manager [req-c689a2d2-f48e-43eb-8fbf-b6ccd42d334e req-9b4f120f-671f-4852-b132-87e1749cc2e9 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state rescuing.
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.images [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] c3c199eb-536f-46e7-a9f2-1b123aa62ffb was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.part /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.part /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.converted" returned: 0 in 0.253s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-b6bbef3d-fd17-4683-8b8b-561bef7b8b6a req-868c0296-1f72-4672-8918-9b74ec1fcf5c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Received event network-vif-deleted-1ad882c8-81f9-48ed-a978-734805dd9564 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:01 user nova-compute[75233]: INFO nova.compute.manager [req-b6bbef3d-fd17-4683-8b8b-561bef7b8b6a req-868c0296-1f72-4672-8918-9b74ec1fcf5c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Neutron deleted interface 1ad882c8-81f9-48ed-a978-734805dd9564; detaching it from the instance and deleting it from the info cache
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.network.neutron [req-b6bbef3d-fd17-4683-8b8b-561bef7b8b6a req-868c0296-1f72-4672-8918-9b74ec1fcf5c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:01 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Took 1.82 seconds to deallocate network for instance.
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-b6bbef3d-fd17-4683-8b8b-561bef7b8b6a req-868c0296-1f72-4672-8918-9b74ec1fcf5c service nova] [instance: cf62dc1b-8a7e-48ac-88e7-420ce6b9851c] Detach interface failed, port_id=1ad882c8-81f9-48ed-a978-734805dd9564, reason: Instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "369bead66d7979431fdd95be2117d41784533eb0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "369bead66d7979431fdd95be2117d41784533eb0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "369bead66d7979431fdd95be2117d41784533eb0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.620s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.013s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:01 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Deleted allocations for instance edbd6067-bd46-4f66-a10d-a01e36efca03
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0 --force-share --output=json" returned: 0 in 0.214s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0,backing_fmt=raw /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0,backing_fmt=raw /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue" returned: 0 in 0.055s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "369bead66d7979431fdd95be2117d41784533eb0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'migration_context' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Object Instance<193e4239-ac4b-42d6-a87b-cb3aff3ed71a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Start _get_guest_xml network_info=[{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "vif_mac": "fa:16:3e:b2:7c:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c3c199eb-536f-46e7-a9f2-1b123aa62ffb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JenvmMyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '193e4239-ac4b-42d6-a87b-cb3aff3ed71a', 'attached_at': '', 'detached_at': '', 'volume_id': '41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'serial': '41ad45d8-0292-4962-82f2-9e815f7a9ab6'}, 'delete_on_termination': False, 'attachment_id': '2fbbb4c8-853a-494f-b5f4-de319bfb4ae7', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'resources' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4afc75fd-788a-4f64-8f36-62a371db74f2 tempest-TaggedBootDevicesTest-886833816 tempest-TaggedBootDevicesTest-886833816-project-member] Lock "edbd6067-bd46-4f66-a10d-a01e36efca03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.582s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Object Instance<193e4239-ac4b-42d6-a87b-cb3aff3ed71a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'numa_topology' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Object Instance<193e4239-ac4b-42d6-a87b-cb3aff3ed71a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:01 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:01 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'vcpu_model' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.objects.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Object Instance<193e4239-ac4b-42d6-a87b-cb3aff3ed71a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JenvmMyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:43:01 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:43:01 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:43:01 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e50245-0e40-4729-83ee-544fadd3a522]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JenvmMyw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 13:43:01 user nova-compute[75233]: node.name = iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6
Dec 05 13:43:01 user nova-compute[75233]: node.tpgt = -1
Dec 05 13:43:01 user nova-compute[75233]: node.startup = automatic
Dec 05 13:43:01 user nova-compute[75233]: node.leading_login = No
Dec 05 13:43:01 user nova-compute[75233]: iface.iscsi_ifacename = default
Dec 05 13:43:01 user nova-compute[75233]: iface.net_ifacename = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.ipaddress = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.prefix_len = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.hwaddress = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.transport_name = tcp
Dec 05 13:43:01 user nova-compute[75233]: iface.initiatorname = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.vlan_id = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.vlan_priority = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.vlan_state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.iface_num = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.mtu = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.port = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.bootproto = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.subnet_mask = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.gateway = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_alt_client_id = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_dns = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_learn_iqn = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_vendor_id_state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_vendor_id = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.dhcp_slp_da = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.fragmentation = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.gratuitous_arp = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.incoming_forwarding = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.tos_state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.tos = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.ttl = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.delayed_ack = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.tcp_nagle = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.tcp_wsf_state = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.tcp_wsf = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.tcp_timer_scale = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.tcp_timestamp = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.redirect = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.def_task_mgmt_timeout = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.header_digest = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.data_digest = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.immediate_data = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.initial_r2t = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.data_seq_inorder = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.data_pdu_inorder = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.erl = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.max_receive_data_len = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.first_burst_len = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.max_outstanding_r2t = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.max_burst_len = 0
Dec 05 13:43:01 user nova-compute[75233]: iface.chap_auth = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.bidi_chap = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.strict_login_compliance = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.discovery_auth = <empty>
Dec 05 13:43:01 user nova-compute[75233]: iface.discovery_logout = <empty>
Dec 05 13:43:01 user nova-compute[75233]: node.discovery_address = <empty>
Dec 05 13:43:01 user nova-compute[75233]: node.discovery_port = 0
Dec 05 13:43:01 user nova-compute[75233]: node.discovery_type = static
Dec 05 13:43:01 user nova-compute[75233]: node.session.initial_cmdsn = 0
Dec 05 13:43:01 user nova-compute[75233]: node.session.initial_login_retry_max = 8
Dec 05 13:43:01 user nova-compute[75233]: node.session.xmit_thread_priority = -20
Dec 05 13:43:01 user nova-compute[75233]: node.session.cmds_max = 128
Dec 05 13:43:01 user nova-compute[75233]: node.session.queue_depth = 32
Dec 05 13:43:01 user nova-compute[75233]: node.session.nr_sessions = 1
Dec 05 13:43:01 user nova-compute[75233]: node.session.auth.authmethod = CHAP
Dec 05 13:43:01 user nova-compute[75233]: node.session.auth.username = JenvmMyw
Dec 05 13:43:01 user nova-compute[75233]: node.session.auth.password = ***
Dec 05 13:43:01 user nova-compute[75233]: node.session.auth.username_in = <empty>
Dec 05 13:43:01 user nova-compute[75233]: node.session.auth.password_in = <empty>
Dec 05 13:43:01 user nova-compute[75233]: node.session.auth.chap_algs = MD5
Dec 05 13:43:01 user nova-compute[75233]: node.session.timeo.replacement_timeout = 120
Dec 05 13:43:01 user nova-compute[75233]: node.session.err_timeo.abort_timeout = 15
Dec 05 13:43:01 user nova-compute[75233]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 13:43:01 user nova-compute[75233]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 13:43:01 user nova-compute[75233]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.FastAbort = Yes
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.InitialR2T = No
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.ImmediateData = Yes
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.MaxConnections = 1
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 13:43:01 user nova-compute[75233]: node.session.iscsi.ERL = 0
Dec 05 13:43:01 user nova-compute[75233]: node.session.scan = manual
Dec 05 13:43:01 user nova-compute[75233]: node.session.reopen_max = 0
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].address = 172.16.0.220
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].port = 3260
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].startup = manual
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].tcp.window_size = 524288
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].tcp.type_of_service = 0
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].timeo.logout_timeout = 15
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].timeo.login_timeout = 15
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].timeo.auth_timeout = 45
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].iscsi.DataDigest = None
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].iscsi.IFMarker = No
Dec 05 13:43:01 user nova-compute[75233]: node.conn[0].iscsi.OFMarker = No
Dec 05 13:43:01 user nova-compute[75233]: # END RECORD
Dec 05 13:43:01 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[101a61e1-2f2e-4df8-b8d8-54e5e4fe99fa]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2548c1-8c29-43f7-a87c-c962eeed395e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JenvmMyw {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JenvmMyw" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c9c7c-013a-4d30-8050-cb3f57aa3132]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JenvmMyw'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e387f7-402e-4a21-9034-9872e9892259]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:02 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Deleted allocations for instance cf62dc1b-8a7e-48ac-88e7-420ce6b9851c
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8aecf-88b0-49e6-882b-c77588857f70]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:43:02 user nova-compute[75233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:43:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:43:02 user nova-compute[75233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:43:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] HCTL ('34', '0', '0', 0) found on session 19 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c319725d-3066-40f2-aa5c-80417cf63356]: (4, ('0 0 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Searching for a device in session 19 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JenvmMyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] <== connect_volume: return (198ms) {'type': 'block', 'scsi_wwn': '23762346365633938', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762346365633938', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-618450068',display_name='tempest-ServerStableDeviceRescueTest-server-618450068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-618450068',id=3,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCyvHhzGmozq6uruCNlWPIfLj6uVQK8EP7eWv5aXgCSUtxhFvniepOEQrmaNb6W5GNVSyeRLN51P6XksSXhXlMNxIL4hzl4fOrJYtVmGzfArN0YnViqm0PItIXPSLIeFA==',key_name='tempest-keypair-777986006',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='068310b985b44818bb545496e9c20239',ramdisk_id='',reservation_id='r-a01ctks7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-507168574',owner_user_name='tempest-ServerStableDeviceRescueTest-507168574-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef50a1eea44e9bbac2fdb4b32a8776',uuid=193e4239-ac4b-42d6-a87b-cb3aff3ed71a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "vif_mac": "fa:16:3e:b2:7c:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converting VIF {"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "vif_mac": "fa:16:3e:b2:7c:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'pci_devices' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f896d111-6bd8-4d37-9b2d-4bf635c5e56e tempest-TaggedAttachmentsTest-930674786 tempest-TaggedAttachmentsTest-930674786-project-member] Lock "cf62dc1b-8a7e-48ac-88e7-420ce6b9851c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.073s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.objects.base [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Object Instance<193e4239-ac4b-42d6-a87b-cb3aff3ed71a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:43:02 user nova-compute[75233]:   <uuid>193e4239-ac4b-42d6-a87b-cb3aff3ed71a</uuid>
Dec 05 13:43:02 user nova-compute[75233]:   <name>instance-00000003</name>
Dec 05 13:43:02 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:43:02 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:43:02 user nova-compute[75233]:   <metadata>
Dec 05 13:43:02 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:43:02 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:43:02 user nova-compute[75233]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-618450068</nova:name>
Dec 05 13:43:02 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:43:01</nova:creationTime>
Dec 05 13:43:02 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:43:02 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:43:02 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:43:02 user nova-compute[75233]:       <nova:owner>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:user uuid="cdef50a1eea44e9bbac2fdb4b32a8776">tempest-ServerStableDeviceRescueTest-507168574-project-member</nova:user>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:project uuid="068310b985b44818bb545496e9c20239">tempest-ServerStableDeviceRescueTest-507168574</nova:project>
Dec 05 13:43:02 user nova-compute[75233]:       </nova:owner>
Dec 05 13:43:02 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:43:02 user nova-compute[75233]:       <nova:ports>
Dec 05 13:43:02 user nova-compute[75233]:         <nova:port uuid="ae30a80c-81bb-4488-87f3-0f7b25393f6d">
Dec 05 13:43:02 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 13:43:02 user nova-compute[75233]:         </nova:port>
Dec 05 13:43:02 user nova-compute[75233]:       </nova:ports>
Dec 05 13:43:02 user nova-compute[75233]:     </nova:instance>
Dec 05 13:43:02 user nova-compute[75233]:   </metadata>
Dec 05 13:43:02 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:43:02 user nova-compute[75233]:     <system>
Dec 05 13:43:02 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:43:02 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:43:02 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:43:02 user nova-compute[75233]:       <entry name="serial">193e4239-ac4b-42d6-a87b-cb3aff3ed71a</entry>
Dec 05 13:43:02 user nova-compute[75233]:       <entry name="uuid">193e4239-ac4b-42d6-a87b-cb3aff3ed71a</entry>
Dec 05 13:43:02 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:43:02 user nova-compute[75233]:     </system>
Dec 05 13:43:02 user nova-compute[75233]:   </sysinfo>
Dec 05 13:43:02 user nova-compute[75233]:   <os>
Dec 05 13:43:02 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:43:02 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:43:02 user nova-compute[75233]:   </os>
Dec 05 13:43:02 user nova-compute[75233]:   <features>
Dec 05 13:43:02 user nova-compute[75233]:     <acpi/>
Dec 05 13:43:02 user nova-compute[75233]:     <apic/>
Dec 05 13:43:02 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:43:02 user nova-compute[75233]:   </features>
Dec 05 13:43:02 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:43:02 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:43:02 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:43:02 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:43:02 user nova-compute[75233]:   </clock>
Dec 05 13:43:02 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:43:02 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:43:02 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:43:02 user nova-compute[75233]:   </cpu>
Dec 05 13:43:02 user nova-compute[75233]:   <devices>
Dec 05 13:43:02 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:43:02 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:43:02 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk"/>
Dec 05 13:43:02 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:43:02 user nova-compute[75233]:     </disk>
Dec 05 13:43:02 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:43:02 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:43:02 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 13:43:02 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:43:02 user nova-compute[75233]:       <serial>41ad45d8-0292-4962-82f2-9e815f7a9ab6</serial>
Dec 05 13:43:02 user nova-compute[75233]:     </disk>
Dec 05 13:43:02 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:43:02 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:43:02 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue"/>
Dec 05 13:43:02 user nova-compute[75233]:       <target dev="vdc" bus="virtio"/>
Dec 05 13:43:02 user nova-compute[75233]:       <boot order="1"/>
Dec 05 13:43:02 user nova-compute[75233]:     </disk>
Dec 05 13:43:02 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:43:02 user nova-compute[75233]:       <mac address="fa:16:3e:b2:7c:53"/>
Dec 05 13:43:02 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:02 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:43:02 user nova-compute[75233]:       <target dev="tapae30a80c-81"/>
Dec 05 13:43:02 user nova-compute[75233]:     </interface>
Dec 05 13:43:02 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:43:02 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/console.log" append="off"/>
Dec 05 13:43:02 user nova-compute[75233]:     </serial>
Dec 05 13:43:02 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:43:02 user nova-compute[75233]:     <video>
Dec 05 13:43:02 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:02 user nova-compute[75233]:     </video>
Dec 05 13:43:02 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:43:02 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:43:02 user nova-compute[75233]:     </rng>
Dec 05 13:43:02 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:43:02 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:43:02 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:43:02 user nova-compute[75233]:     </memballoon>
Dec 05 13:43:02 user nova-compute[75233]:   </devices>
Dec 05 13:43:02 user nova-compute[75233]: </domain>
Dec 05 13:43:02 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:43:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance destroyed successfully.
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] No VIF found with MAC fa:16:3e:b2:7c:53, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:02 user nova-compute[75233]: INFO nova.compute.manager [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Terminating instance
Dec 05 13:43:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f3bca60-717c-41d0-99ea-449473542bcb req-fe4e0f1c-4a2d-4cbb-85d5-13988aae6b55 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-vif-unplugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f3bca60-717c-41d0-99ea-449473542bcb req-fe4e0f1c-4a2d-4cbb-85d5-13988aae6b55 service nova] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f3bca60-717c-41d0-99ea-449473542bcb req-fe4e0f1c-4a2d-4cbb-85d5-13988aae6b55 service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f3bca60-717c-41d0-99ea-449473542bcb req-fe4e0f1c-4a2d-4cbb-85d5-13988aae6b55 service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f3bca60-717c-41d0-99ea-449473542bcb req-fe4e0f1c-4a2d-4cbb-85d5-13988aae6b55 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] No waiting events found dispatching network-vif-unplugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f3bca60-717c-41d0-99ea-449473542bcb req-fe4e0f1c-4a2d-4cbb-85d5-13988aae6b55 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-vif-unplugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:43:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Instance destroyed successfully.
Dec 05 13:43:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lazy-loading 'resources' on Instance uuid 61b72e12-781d-472c-841d-59cacd38578f {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-585286314',display_name='tempest-TestVolumeSwap-server-585286314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-585286314',id=5,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7XR8qJ9Y7EY4Hta1nxa8++9tWwzT1mqOMwGg+/zU1zu2LURTrW+ohZE/deKS1aKww9rD1kqL3V52Slc0WJLcrbrlFsm0IiZVKj0i+wugsGZTvNAD5vESGy1cfBGU1VpQ==',key_name='tempest-keypair-1486432949',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45e0af9097af457f93beec368ac68066',ramdisk_id='',reservation_id='r-58n4g8hr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1953399439',owner_user_name='tempest-TestVolumeSwap-1953399439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='138af9aac17d443aa6218e1b37a53565',uuid=61b72e12-781d-472c-841d-59cacd38578f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Converting VIF {"id": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "address": "fa:16:3e:33:1d:60", "network": {"id": "e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-291736389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e0af9097af457f93beec368ac68066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643f12d8-3b", "ovs_interfaceid": "643f12d8-3bd8-4a62-9bc4-260af906a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG os_vif [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap643f12d8-3b, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe661b61-dcd5-4287-98fa-05a8a3a9b2fe) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: INFO os_vif [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:1d:60,bridge_name='br-int',has_traffic_filtering=True,id=643f12d8-3bd8-4a62-9bc4-260af906a6e3,network=Network(e04ec5e1-d887-4cd3-bd51-7bbaa5b8b46d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643f12d8-3b')
Dec 05 13:43:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Deleting instance files /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f_del
Dec 05 13:43:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Deletion of /opt/stack/data/nova/instances/61b72e12-781d-472c-841d-59cacd38578f_del complete
Dec 05 13:43:04 user nova-compute[75233]: INFO nova.compute.manager [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Took 1.49 seconds to destroy the instance on the hypervisor.
Dec 05 13:43:04 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 61b72e12-781d-472c-841d-59cacd38578f] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Acquiring lock "61b72e12-781d-472c-841d-59cacd38578f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Lock "61b72e12-781d-472c-841d-59cacd38578f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] No waiting events found dispatching network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:05 user nova-compute[75233]: WARNING nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received unexpected event network-vif-plugged-643f12d8-3bd8-4a62-9bc4-260af906a6e3 for instance with vm_state active and task_state deleting.
Dec 05 13:43:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:05 user nova-compute[75233]: WARNING nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state rescuing.
Dec 05 13:43:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:05 user nova-compute[75233]: WARNING nova.compute.manager [req-d4c59eeb-6fb0-45a1-bfc7-a3288f5e09d3 req-63ee4692-a606-421a-b095-f11dc4500a64 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state rescuing.
Dec 05 13:43:06 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:06 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Took 1.85 seconds to deallocate network for instance.
Dec 05 13:43:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-30d64172-cdcd-48ff-a76f-225d0932f106 req-a9fb45b0-1eeb-4d37-bdc5-5d3316478a57 service nova] [instance: 61b72e12-781d-472c-841d-59cacd38578f] Received event network-vif-deleted-643f12d8-3bd8-4a62-9bc4-260af906a6e3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:06 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:06 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Deleted allocations for instance 61b72e12-781d-472c-841d-59cacd38578f
Dec 05 13:43:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-4399a62a-760c-41fc-9ce0-5347a78312d4 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:43:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-269e3569-ed22-4ba8-aa76-74aa507238fe tempest-TestVolumeSwap-1953399439 tempest-TestVolumeSwap-1953399439-project-member] Lock "61b72e12-781d-472c-841d-59cacd38578f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.884s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:43:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:13 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:43:13 user nova-compute[75233]: INFO nova.compute.claims [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Claim successful on node user
Dec 05 13:43:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:43:14 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.policy [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f607b8d442c740fe865f6b96b6dcdcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434c6a79034f4bb79f70faf8c468504e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:43:14 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Creating image(s)
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.217s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.217s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk 1073741824" returned: 0 in 0.059s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Cannot resize image /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Ensure instance console log exists: /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Successfully created port: 217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Successfully updated port: 217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-changed-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Refreshing instance network info cache due to event network-changed-217ff3c3-5eed-435e-b7b1-ec6872e83d24. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:43:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance network_info: |[{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Refreshing network info cache for port 217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start _get_guest_xml network_info=[{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:43:17 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:17 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.objects.instance [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'pci_devices' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:43:17 user nova-compute[75233]:   <uuid>ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</uuid>
Dec 05 13:43:17 user nova-compute[75233]:   <name>instance-0000000f</name>
Dec 05 13:43:17 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:43:17 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:43:17 user nova-compute[75233]:   <metadata>
Dec 05 13:43:17 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:43:17 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:43:17 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherB-server-1529541965</nova:name>
Dec 05 13:43:17 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:43:17</nova:creationTime>
Dec 05 13:43:17 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:43:17 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:43:17 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:43:17 user nova-compute[75233]:       <nova:owner>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:user uuid="f607b8d442c740fe865f6b96b6dcdcbd">tempest-ServerActionsTestOtherB-963894040-project-member</nova:user>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:project uuid="434c6a79034f4bb79f70faf8c468504e">tempest-ServerActionsTestOtherB-963894040</nova:project>
Dec 05 13:43:17 user nova-compute[75233]:       </nova:owner>
Dec 05 13:43:17 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:43:17 user nova-compute[75233]:       <nova:ports>
Dec 05 13:43:17 user nova-compute[75233]:         <nova:port uuid="217ff3c3-5eed-435e-b7b1-ec6872e83d24">
Dec 05 13:43:17 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:43:17 user nova-compute[75233]:         </nova:port>
Dec 05 13:43:17 user nova-compute[75233]:       </nova:ports>
Dec 05 13:43:17 user nova-compute[75233]:     </nova:instance>
Dec 05 13:43:17 user nova-compute[75233]:   </metadata>
Dec 05 13:43:17 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:43:17 user nova-compute[75233]:     <system>
Dec 05 13:43:17 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:43:17 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:43:17 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:43:17 user nova-compute[75233]:       <entry name="serial">ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</entry>
Dec 05 13:43:17 user nova-compute[75233]:       <entry name="uuid">ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</entry>
Dec 05 13:43:17 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:43:17 user nova-compute[75233]:     </system>
Dec 05 13:43:17 user nova-compute[75233]:   </sysinfo>
Dec 05 13:43:17 user nova-compute[75233]:   <os>
Dec 05 13:43:17 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:43:17 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:43:17 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:43:17 user nova-compute[75233]:   </os>
Dec 05 13:43:17 user nova-compute[75233]:   <features>
Dec 05 13:43:17 user nova-compute[75233]:     <acpi/>
Dec 05 13:43:17 user nova-compute[75233]:     <apic/>
Dec 05 13:43:17 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:43:17 user nova-compute[75233]:   </features>
Dec 05 13:43:17 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:43:17 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:43:17 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:43:17 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:43:17 user nova-compute[75233]:   </clock>
Dec 05 13:43:17 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:43:17 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:43:17 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:43:17 user nova-compute[75233]:   </cpu>
Dec 05 13:43:17 user nova-compute[75233]:   <devices>
Dec 05 13:43:17 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:43:17 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:43:17 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk"/>
Dec 05 13:43:17 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:43:17 user nova-compute[75233]:     </disk>
Dec 05 13:43:17 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:43:17 user nova-compute[75233]:       <mac address="fa:16:3e:84:db:58"/>
Dec 05 13:43:17 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:17 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:43:17 user nova-compute[75233]:       <target dev="tap217ff3c3-5e"/>
Dec 05 13:43:17 user nova-compute[75233]:     </interface>
Dec 05 13:43:17 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:43:17 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/console.log" append="off"/>
Dec 05 13:43:17 user nova-compute[75233]:     </serial>
Dec 05 13:43:17 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:43:17 user nova-compute[75233]:     <video>
Dec 05 13:43:17 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:17 user nova-compute[75233]:     </video>
Dec 05 13:43:17 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:43:17 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:43:17 user nova-compute[75233]:     </rng>
Dec 05 13:43:17 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:43:17 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:43:17 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:43:17 user nova-compute[75233]:     </memballoon>
Dec 05 13:43:17 user nova-compute[75233]:   </devices>
Dec 05 13:43:17 user nova-compute[75233]: </domain>
Dec 05 13:43:17 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG os_vif [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36de330a-e990-515a-a496-2ad64990ee81', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217ff3c3-5e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap217ff3c3-5e, col_values=(('qos', UUID('ed52bdba-092c-41f0-95d8-4c99ff84ecf3')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap217ff3c3-5e, col_values=(('external_ids', {'iface-id': '217ff3c3-5eed-435e-b7b1-ec6872e83d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:db:58', 'vm-uuid': 'ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: INFO os_vif [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e')
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No VIF found with MAC fa:16:3e:84:db:58, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updated VIF entry in instance network info cache for port 217ff3c3-5eed-435e-b7b1-ec6872e83d24. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d672195b-a4f6-4118-89b4-13a7faa7db32 req-8c2a2b40-9a7f-4804-8d08-2ed98ec81ace service nova] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:17 user nova-compute[75233]: INFO nova.compute.manager [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Terminating instance
Dec 05 13:43:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-unplugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-unplugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-unplugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] Acquiring lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] No waiting events found dispatching network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:18 user nova-compute[75233]: WARNING nova.compute.manager [req-8b843c35-7f80-491a-9b1f-106ac93bd9e8 req-7694b78b-9e30-4e88-822c-b0436f9dc18a service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received unexpected event network-vif-plugged-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c for instance with vm_state active and task_state deleting.
Dec 05 13:43:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Instance destroyed successfully.
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lazy-loading 'resources' on Instance uuid 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1541058515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-198484875',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBjirTdgwguXf8pJpDGH38q17eBDHncaQ+iB6D3hlb+s4hJpshKYtlQvlsbwGbpt6MhXarCfCtSdWaWLFu4ehJfgNc1TbGggoGeDFMM241T3aOm8pSjB5QSszJrkc/AA==',key_name='tempest-keypair-791952996',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:42:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e4d0d8d26d14eebac1d61089119a062',ramdisk_id='',reservation_id='r-5tvy1x7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1073184207',owner_user_name='tempest-ServerActionsV293TestJSON-1073184207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158e2993042b45339f98fc5fff0aaf2c',uuid=0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converting VIF {"id": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "address": "fa:16:3e:be:ca:d7", "network": {"id": "b30531c5-1727-466d-8941-887cbcf9070b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1260356269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e4d0d8d26d14eebac1d61089119a062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9a4a9a-4a", "ovs_interfaceid": "2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:18 user nova-compute[75233]: DEBUG os_vif [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a9a4a9a-4a, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6770350-5e25-47d4-a032-f380cef706f1) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: INFO os_vif [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ca:d7,bridge_name='br-int',has_traffic_filtering=True,id=2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c,network=Network(b30531c5-1727-466d-8941-887cbcf9070b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9a4a9a-4a')
Dec 05 13:43:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToLYGdhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:43:19 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[370918ee-2561-4953-8fff-763d6b8fbd6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:43:19 user nova-compute[75233]: No targets found.
Dec 05 13:43:19 user nova-compute[75233]: iSNS:
Dec 05 13:43:19 user nova-compute[75233]: No targets found.
Dec 05 13:43:19 user nova-compute[75233]: STATIC:
Dec 05 13:43:19 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6
Dec 05 13:43:19 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:43:19 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:43:19 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1
Dec 05 13:43:19 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:43:19 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:43:19 user nova-compute[75233]: FIRMWARE:
Dec 05 13:43:19 user nova-compute[75233]: No targets found.
Dec 05 13:43:19 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:43:19 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:43:19 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58965b3-f853-4b91-8113-dd916d3ac688]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d217c93-6fe7-4f62-98cc-15ca858c44fd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:43:19 user nova-compute[75233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:43:19 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 (non-flash)
Dec 05 13:43:19 user nova-compute[75233]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:43:19 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34767d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e18e01-828f-4677-be3d-2f0ebd0bc47b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a9944b5-2069-415a-a519-1359d0e3cf1c req-43d850eb-9ea2-4232-a185-5730b1bbf33e service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a9944b5-2069-415a-a519-1359d0e3cf1c req-43d850eb-9ea2-4232-a185-5730b1bbf33e service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a9944b5-2069-415a-a519-1359d0e3cf1c req-43d850eb-9ea2-4232-a185-5730b1bbf33e service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a9944b5-2069-415a-a519-1359d0e3cf1c req-43d850eb-9ea2-4232-a185-5730b1bbf33e service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a9944b5-2069-415a-a519-1359d0e3cf1c req-43d850eb-9ea2-4232-a185-5730b1bbf33e service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:19 user nova-compute[75233]: WARNING nova.compute.manager [req-6a9944b5-2069-415a-a519-1359d0e3cf1c req-43d850eb-9ea2-4232-a185-5730b1bbf33e service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state building and task_state spawning.
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.035s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409d7c5-7ddd-489f-834c-e5b8186200bd]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f791ed24-bf0e-4a12-b7ea-af148096059c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fffc6d-f469-4b56-8861-a4f22a404d8c]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcfe85a-5a60-42b9-9f56-94701a57f359]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a174c-c3d6-4e4d-a652-4462eda03151]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260]
Dec 05 13:43:19 user nova-compute[75233]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1, portal: 172.16.0.220,3260] successful.
Dec 05 13:43:19 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6621e3db-b8d2-4e8b-b76c-e7af765972e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ad7ab1-906f-4340-b49b-f5064418b76a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] <== disconnect_volume: return (432ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:43:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Deleting instance files /opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5_del
Dec 05 13:43:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Deletion of /opt/stack/data/nova/instances/0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5_del complete
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: INFO nova.compute.manager [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Took 1.95 seconds to destroy the instance on the hypervisor.
Dec 05 13:43:19 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:20 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:20 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Took 0.99 seconds to deallocate network for instance.
Dec 05 13:43:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-d5e8252a-1cd0-46f8-9473-01372736f562 req-75b7249f-59c5-47aa-8825-135698c124ff service nova] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Received event network-vif-deleted-2a9a4a9a-4a9e-4d01-b014-0e9b53cd423c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:43:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance spawned successfully.
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-da188956-f5c8-42ce-8a9a-bfe67d8dd822 req-1f10a715-5ae5-4238-a802-6b166863d5ad service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-da188956-f5c8-42ce-8a9a-bfe67d8dd822 req-1f10a715-5ae5-4238-a802-6b166863d5ad service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-da188956-f5c8-42ce-8a9a-bfe67d8dd822 req-1f10a715-5ae5-4238-a802-6b166863d5ad service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-da188956-f5c8-42ce-8a9a-bfe67d8dd822 req-1f10a715-5ae5-4238-a802-6b166863d5ad service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-da188956-f5c8-42ce-8a9a-bfe67d8dd822 req-1f10a715-5ae5-4238-a802-6b166863d5ad service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:21 user nova-compute[75233]: WARNING nova.compute.manager [req-da188956-f5c8-42ce-8a9a-bfe67d8dd822 req-1f10a715-5ae5-4238-a802-6b166863d5ad service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state building and task_state spawning.
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:21 user nova-compute[75233]: INFO nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Took 6.94 seconds to spawn the instance on the hypervisor.
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:43:21 user nova-compute[75233]: INFO nova.compute.manager [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Took 7.79 seconds to build instance.
Dec 05 13:43:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90e73631-e56d-4c82-8905-66fd85c53c5a tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.926s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:21 user nova-compute[75233]: INFO nova.compute.manager [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Took 1.11 seconds to detach 1 volumes for instance.
Dec 05 13:43:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] [instance: 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5] Deleting volume: 6621e3db-b8d2-4e8b-b76c-e7af765972e1 {{(pid=75233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:22 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:22 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:22 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Deleted allocations for instance 0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5
Dec 05 13:43:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f8e80cf5-227d-4da2-92cf-d47f56f084cb tempest-ServerActionsV293TestJSON-1073184207 tempest-ServerActionsV293TestJSON-1073184207-project-member] Lock "0ed7a56d-3e5d-4a5e-8a19-3e260a5fc5b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.632s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:25 user nova-compute[75233]: INFO nova.compute.manager [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Rescuing
Dec 05 13:43:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:43:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:43:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:43:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:43:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-4d8d1cd8-7e48-4aee-a81d-154f6487eaf4 req-71ed5712-4ba3-46c3-9e24-26b278a4d341 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4d8d1cd8-7e48-4aee-a81d-154f6487eaf4 req-71ed5712-4ba3-46c3-9e24-26b278a4d341 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4d8d1cd8-7e48-4aee-a81d-154f6487eaf4 req-71ed5712-4ba3-46c3-9e24-26b278a4d341 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4d8d1cd8-7e48-4aee-a81d-154f6487eaf4 req-71ed5712-4ba3-46c3-9e24-26b278a4d341 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-4d8d1cd8-7e48-4aee-a81d-154f6487eaf4 req-71ed5712-4ba3-46c3-9e24-26b278a4d341 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:26 user nova-compute[75233]: WARNING nova.compute.manager [req-4d8d1cd8-7e48-4aee-a81d-154f6487eaf4 req-71ed5712-4ba3-46c3-9e24-26b278a4d341 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state active and task_state rescuing.
Dec 05 13:43:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance destroyed successfully.
Dec 05 13:43:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Attempting rescue
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:43:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Creating image(s)
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue" returned: 0 in 0.048s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'migration_context' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.base [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<2bec11aa-9bc8-4724-8d1c-1dd2aa813dda> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Start _get_guest_xml network_info=[{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:d5:95:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'resources' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.base [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<2bec11aa-9bc8-4724-8d1c-1dd2aa813dda> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.objects.base [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<2bec11aa-9bc8-4724-8d1c-1dd2aa813dda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:43:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.objects.base [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<2bec11aa-9bc8-4724-8d1c-1dd2aa813dda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478206480',display_name='tempest-ServerRescueNegativeTestJSON-server-478206480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-478206480',id=1,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:38:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-p8zaf510',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:38:55Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=2bec11aa-9bc8-4724-8d1c-1dd2aa813dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:d5:95:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:d5:95:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.objects.base [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<2bec11aa-9bc8-4724-8d1c-1dd2aa813dda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:43:27 user nova-compute[75233]:   <uuid>2bec11aa-9bc8-4724-8d1c-1dd2aa813dda</uuid>
Dec 05 13:43:27 user nova-compute[75233]:   <name>instance-00000001</name>
Dec 05 13:43:27 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:43:27 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:43:27 user nova-compute[75233]:   <metadata>
Dec 05 13:43:27 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:43:27 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:43:27 user nova-compute[75233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-478206480</nova:name>
Dec 05 13:43:27 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:43:26</nova:creationTime>
Dec 05 13:43:27 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:43:27 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:43:27 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:43:27 user nova-compute[75233]:       <nova:owner>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:user uuid="e7ddf7a828a547e9b606ed9e8e8727eb">tempest-ServerRescueNegativeTestJSON-2142653953-project-member</nova:user>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:project uuid="16b7c3d1e9a7462b8c4833174777873e">tempest-ServerRescueNegativeTestJSON-2142653953</nova:project>
Dec 05 13:43:27 user nova-compute[75233]:       </nova:owner>
Dec 05 13:43:27 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:43:27 user nova-compute[75233]:       <nova:ports>
Dec 05 13:43:27 user nova-compute[75233]:         <nova:port uuid="452eceed-ab34-4c46-9122-6f289fcc7597">
Dec 05 13:43:27 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 13:43:27 user nova-compute[75233]:         </nova:port>
Dec 05 13:43:27 user nova-compute[75233]:       </nova:ports>
Dec 05 13:43:27 user nova-compute[75233]:     </nova:instance>
Dec 05 13:43:27 user nova-compute[75233]:   </metadata>
Dec 05 13:43:27 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:43:27 user nova-compute[75233]:     <system>
Dec 05 13:43:27 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:43:27 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:43:27 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:43:27 user nova-compute[75233]:       <entry name="serial">2bec11aa-9bc8-4724-8d1c-1dd2aa813dda</entry>
Dec 05 13:43:27 user nova-compute[75233]:       <entry name="uuid">2bec11aa-9bc8-4724-8d1c-1dd2aa813dda</entry>
Dec 05 13:43:27 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:43:27 user nova-compute[75233]:     </system>
Dec 05 13:43:27 user nova-compute[75233]:   </sysinfo>
Dec 05 13:43:27 user nova-compute[75233]:   <os>
Dec 05 13:43:27 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:43:27 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:43:27 user nova-compute[75233]:   </os>
Dec 05 13:43:27 user nova-compute[75233]:   <features>
Dec 05 13:43:27 user nova-compute[75233]:     <acpi/>
Dec 05 13:43:27 user nova-compute[75233]:     <apic/>
Dec 05 13:43:27 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:43:27 user nova-compute[75233]:   </features>
Dec 05 13:43:27 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:43:27 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:43:27 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:43:27 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:43:27 user nova-compute[75233]:   </clock>
Dec 05 13:43:27 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:43:27 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:43:27 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:43:27 user nova-compute[75233]:   </cpu>
Dec 05 13:43:27 user nova-compute[75233]:   <devices>
Dec 05 13:43:27 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:43:27 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:43:27 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue"/>
Dec 05 13:43:27 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:43:27 user nova-compute[75233]:     </disk>
Dec 05 13:43:27 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:43:27 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:43:27 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk"/>
Dec 05 13:43:27 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:43:27 user nova-compute[75233]:     </disk>
Dec 05 13:43:27 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:43:27 user nova-compute[75233]:       <mac address="fa:16:3e:d5:95:cc"/>
Dec 05 13:43:27 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:27 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:43:27 user nova-compute[75233]:       <target dev="tap452eceed-ab"/>
Dec 05 13:43:27 user nova-compute[75233]:     </interface>
Dec 05 13:43:27 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:43:27 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/console.log" append="off"/>
Dec 05 13:43:27 user nova-compute[75233]:     </serial>
Dec 05 13:43:27 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:43:27 user nova-compute[75233]:     <video>
Dec 05 13:43:27 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:27 user nova-compute[75233]:     </video>
Dec 05 13:43:27 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:43:27 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:43:27 user nova-compute[75233]:     </rng>
Dec 05 13:43:27 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:43:27 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:43:27 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:43:27 user nova-compute[75233]:     </memballoon>
Dec 05 13:43:27 user nova-compute[75233]:   </devices>
Dec 05 13:43:27 user nova-compute[75233]: </domain>
Dec 05 13:43:27 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:43:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance destroyed successfully.
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:d5:95:cc, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-61741504-29b6-46fb-aa1f-c66aeb83481f req-54a9c5a5-eba4-4ce8-8c6b-777ee6460a1d service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-61741504-29b6-46fb-aa1f-c66aeb83481f req-54a9c5a5-eba4-4ce8-8c6b-777ee6460a1d service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-61741504-29b6-46fb-aa1f-c66aeb83481f req-54a9c5a5-eba4-4ce8-8c6b-777ee6460a1d service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-61741504-29b6-46fb-aa1f-c66aeb83481f req-54a9c5a5-eba4-4ce8-8c6b-777ee6460a1d service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-61741504-29b6-46fb-aa1f-c66aeb83481f req-54a9c5a5-eba4-4ce8-8c6b-777ee6460a1d service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:28 user nova-compute[75233]: WARNING nova.compute.manager [req-61741504-29b6-46fb-aa1f-c66aeb83481f req-54a9c5a5-eba4-4ce8-8c6b-777ee6460a1d service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state active and task_state rescuing.
Dec 05 13:43:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:30 user nova-compute[75233]: WARNING nova.compute.manager [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state active and task_state rescuing.
Dec 05 13:43:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:30 user nova-compute[75233]: WARNING nova.compute.manager [req-f0ca536a-82f0-484f-a133-23d9908941ba req-a5511a01-54a3-4017-856e-32185891db27 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state active and task_state rescuing.
Dec 05 13:43:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95928545-0a1e-49b7-8476-4752d3c9165c tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:43:34 user nova-compute[75233]: INFO nova.compute.claims [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Claim successful on node user
Dec 05 13:43:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:34 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:43:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.policy [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e64aa1ef9e44d52a0587c6b009a1e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc0f5f6a8ad42c989c5900f97815384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:43:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Creating image(s)
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "/opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "/opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.234s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk 1073741824" returned: 0 in 0.075s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.231s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Cannot resize image /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Ensure instance console log exists: /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:36 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Successfully created port: dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Successfully updated port: dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquired lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-changed-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Refreshing instance network info cache due to event network-changed-dc658684-4b4c-4829-8d3d-ed1e44aeb5be. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] Acquiring lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updating instance_info_cache with network_info: [{"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Releasing lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Instance network_info: |[{"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] Acquired lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.network.neutron [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Refreshing network info cache for port dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Start _get_guest_xml network_info=[{"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:43:37 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:37 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:43:37 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1100068851',display_name='tempest-VolumesSnapshotTestJSON-instance-1100068851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1100068851',id=16,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCbw7OJPihQt9Ijf/NVaOzKpcPqZ6GSEU7zQTS1IuAqrbtVzqs7pN5Y6xee4wr7Gg61G3r3Zmi0914utrcrW28kyyp6zbDlP/t6Jk3Cb2RVXjivsh+dzDRVIC0xLAwWng==',key_name='tempest-keypair-480069886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc0f5f6a8ad42c989c5900f97815384',ramdisk_id='',reservation_id='r-lr97balv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1540026955',owner_user_name='tempest-VolumesSnapshotTestJSON-1540026955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e64aa1ef9e44d52a0587c6b009a1e9a',uuid=d1462005-63a7-4b1e-b636-2f0daa7d5700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converting VIF {"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'pci_devices' on Instance uuid d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:43:38 user nova-compute[75233]:   <uuid>d1462005-63a7-4b1e-b636-2f0daa7d5700</uuid>
Dec 05 13:43:38 user nova-compute[75233]:   <name>instance-00000010</name>
Dec 05 13:43:38 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:43:38 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:43:38 user nova-compute[75233]:   <metadata>
Dec 05 13:43:38 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:43:38 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:43:38 user nova-compute[75233]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1100068851</nova:name>
Dec 05 13:43:38 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:43:37</nova:creationTime>
Dec 05 13:43:38 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:43:38 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:43:38 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:43:38 user nova-compute[75233]:       <nova:owner>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:user uuid="7e64aa1ef9e44d52a0587c6b009a1e9a">tempest-VolumesSnapshotTestJSON-1540026955-project-member</nova:user>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:project uuid="dcc0f5f6a8ad42c989c5900f97815384">tempest-VolumesSnapshotTestJSON-1540026955</nova:project>
Dec 05 13:43:38 user nova-compute[75233]:       </nova:owner>
Dec 05 13:43:38 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:43:38 user nova-compute[75233]:       <nova:ports>
Dec 05 13:43:38 user nova-compute[75233]:         <nova:port uuid="dc658684-4b4c-4829-8d3d-ed1e44aeb5be">
Dec 05 13:43:38 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:43:38 user nova-compute[75233]:         </nova:port>
Dec 05 13:43:38 user nova-compute[75233]:       </nova:ports>
Dec 05 13:43:38 user nova-compute[75233]:     </nova:instance>
Dec 05 13:43:38 user nova-compute[75233]:   </metadata>
Dec 05 13:43:38 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:43:38 user nova-compute[75233]:     <system>
Dec 05 13:43:38 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:43:38 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:43:38 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:43:38 user nova-compute[75233]:       <entry name="serial">d1462005-63a7-4b1e-b636-2f0daa7d5700</entry>
Dec 05 13:43:38 user nova-compute[75233]:       <entry name="uuid">d1462005-63a7-4b1e-b636-2f0daa7d5700</entry>
Dec 05 13:43:38 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:43:38 user nova-compute[75233]:     </system>
Dec 05 13:43:38 user nova-compute[75233]:   </sysinfo>
Dec 05 13:43:38 user nova-compute[75233]:   <os>
Dec 05 13:43:38 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:43:38 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:43:38 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:43:38 user nova-compute[75233]:   </os>
Dec 05 13:43:38 user nova-compute[75233]:   <features>
Dec 05 13:43:38 user nova-compute[75233]:     <acpi/>
Dec 05 13:43:38 user nova-compute[75233]:     <apic/>
Dec 05 13:43:38 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:43:38 user nova-compute[75233]:   </features>
Dec 05 13:43:38 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:43:38 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:43:38 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:43:38 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:43:38 user nova-compute[75233]:   </clock>
Dec 05 13:43:38 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:43:38 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:43:38 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:43:38 user nova-compute[75233]:   </cpu>
Dec 05 13:43:38 user nova-compute[75233]:   <devices>
Dec 05 13:43:38 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:43:38 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:43:38 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk"/>
Dec 05 13:43:38 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:43:38 user nova-compute[75233]:     </disk>
Dec 05 13:43:38 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:43:38 user nova-compute[75233]:       <mac address="fa:16:3e:1b:43:63"/>
Dec 05 13:43:38 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:38 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:43:38 user nova-compute[75233]:       <target dev="tapdc658684-4b"/>
Dec 05 13:43:38 user nova-compute[75233]:     </interface>
Dec 05 13:43:38 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:43:38 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/console.log" append="off"/>
Dec 05 13:43:38 user nova-compute[75233]:     </serial>
Dec 05 13:43:38 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:43:38 user nova-compute[75233]:     <video>
Dec 05 13:43:38 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:43:38 user nova-compute[75233]:     </video>
Dec 05 13:43:38 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:43:38 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:43:38 user nova-compute[75233]:     </rng>
Dec 05 13:43:38 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:43:38 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:43:38 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:43:38 user nova-compute[75233]:     </memballoon>
Dec 05 13:43:38 user nova-compute[75233]:   </devices>
Dec 05 13:43:38 user nova-compute[75233]: </domain>
Dec 05 13:43:38 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1100068851',display_name='tempest-VolumesSnapshotTestJSON-instance-1100068851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1100068851',id=16,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCbw7OJPihQt9Ijf/NVaOzKpcPqZ6GSEU7zQTS1IuAqrbtVzqs7pN5Y6xee4wr7Gg61G3r3Zmi0914utrcrW28kyyp6zbDlP/t6Jk3Cb2RVXjivsh+dzDRVIC0xLAwWng==',key_name='tempest-keypair-480069886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc0f5f6a8ad42c989c5900f97815384',ramdisk_id='',reservation_id='r-lr97balv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1540026955',owner_user_name='tempest-VolumesSnapshotTestJSON-1540026955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e64aa1ef9e44d52a0587c6b009a1e9a',uuid=d1462005-63a7-4b1e-b636-2f0daa7d5700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converting VIF {"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG os_vif [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1aebcfe-1eb3-5230-8a68-552249d88c2d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc658684-4b, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc658684-4b, col_values=(('qos', UUID('d42724da-22af-42f8-b41b-e96da763e334')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc658684-4b, col_values=(('external_ids', {'iface-id': 'dc658684-4b4c-4829-8d3d-ed1e44aeb5be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:43:63', 'vm-uuid': 'd1462005-63a7-4b1e-b636-2f0daa7d5700'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:38 user nova-compute[75233]: INFO os_vif [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b')
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:43:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No VIF found with MAC fa:16:3e:1b:43:63, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updated VIF entry in instance network info cache for port dc658684-4b4c-4829-8d3d-ed1e44aeb5be. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updating instance_info_cache with network_info: [{"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cdbce505-c788-49ec-9e31-1e16badae65c req-017b2375-f39b-4e66-8fad-ea0de1f139b7 service nova] Releasing lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-9a4557c2-16d1-46c3-b28d-06da652a57de req-92aa5268-98a3-4ecf-9546-f98dbbbb353d service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9a4557c2-16d1-46c3-b28d-06da652a57de req-92aa5268-98a3-4ecf-9546-f98dbbbb353d service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9a4557c2-16d1-46c3-b28d-06da652a57de req-92aa5268-98a3-4ecf-9546-f98dbbbb353d service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9a4557c2-16d1-46c3-b28d-06da652a57de req-92aa5268-98a3-4ecf-9546-f98dbbbb353d service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-9a4557c2-16d1-46c3-b28d-06da652a57de req-92aa5268-98a3-4ecf-9546-f98dbbbb353d service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:40 user nova-compute[75233]: WARNING nova.compute.manager [req-9a4557c2-16d1-46c3-b28d-06da652a57de req-92aa5268-98a3-4ecf-9546-f98dbbbb353d service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received unexpected event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with vm_state building and task_state spawning.
Dec 05 13:43:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:43:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-5af29532-b819-4648-a0e1-8e9f5982d97a req-f2b40cac-9d2b-4981-bf11-b0fb332d2c40 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5af29532-b819-4648-a0e1-8e9f5982d97a req-f2b40cac-9d2b-4981-bf11-b0fb332d2c40 service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5af29532-b819-4648-a0e1-8e9f5982d97a req-f2b40cac-9d2b-4981-bf11-b0fb332d2c40 service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5af29532-b819-4648-a0e1-8e9f5982d97a req-f2b40cac-9d2b-4981-bf11-b0fb332d2c40 service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-5af29532-b819-4648-a0e1-8e9f5982d97a req-f2b40cac-9d2b-4981-bf11-b0fb332d2c40 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:43:42 user nova-compute[75233]: WARNING nova.compute.manager [req-5af29532-b819-4648-a0e1-8e9f5982d97a req-f2b40cac-9d2b-4981-bf11-b0fb332d2c40 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received unexpected event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with vm_state building and task_state spawning.
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:43:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Instance spawned successfully.
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:42 user nova-compute[75233]: INFO nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Took 7.14 seconds to spawn the instance on the hypervisor.
Dec 05 13:43:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:43:42 user nova-compute[75233]: INFO nova.compute.manager [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Took 8.18 seconds to build instance.
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ac9bdcd9-d666-416d-ac38-1ffaf2285365 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.385s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:43:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:43:45 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:45 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:43:45 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=25.231239318847656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:43:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:43:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 63978594-a36a-47f8-a596-4e6c1b965e7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ea52330e-ed18-4c84-bd28-ca464c968ebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance d1462005-63a7-4b1e-b636-2f0daa7d5700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:43:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:43:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:43:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:43:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:43:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 13:43:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:43:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "ea52330e-ed18-4c84-bd28-ca464c968ebf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:15 user nova-compute[75233]: INFO nova.compute.manager [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Terminating instance
Dec 05 13:44:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Instance destroyed successfully.
Dec 05 13:44:16 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'resources' on Instance uuid ea52330e-ed18-4c84-bd28-ca464c968ebf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2064093302',display_name='tempest-VolumesAdminNegativeTest-server-2064093302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2064093302',id=14,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='426a7cafbfd54c23a56c584b9107d871',ramdisk_id='',reservation_id='r-5mtrqek6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2110311291',owner_user_name='tempest-VolumesAdminNegativeTest-2110311291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:42:23Z,user_data=None,user_id='e28e6b2894c844ae864b0283b8824371',uuid=ea52330e-ed18-4c84-bd28-ca464c968ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converting VIF {"id": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "address": "fa:16:3e:f8:4b:d0", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape298c0ed-2f", "ovs_interfaceid": "e298c0ed-2f03-4558-8a92-e6172b076cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG os_vif [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape298c0ed-2f, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70e87e3b-b9be-4780-8aa3-0f683ef472cf) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:16 user nova-compute[75233]: INFO os_vif [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:4b:d0,bridge_name='br-int',has_traffic_filtering=True,id=e298c0ed-2f03-4558-8a92-e6172b076cfe,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape298c0ed-2f')
Dec 05 13:44:16 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Deleting instance files /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf_del
Dec 05 13:44:16 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Deletion of /opt/stack/data/nova/instances/ea52330e-ed18-4c84-bd28-ca464c968ebf_del complete
Dec 05 13:44:16 user nova-compute[75233]: INFO nova.compute.manager [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Took 0.70 seconds to destroy the instance on the hypervisor.
Dec 05 13:44:16 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:44:16 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:44:17 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:17 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Took 1.05 seconds to deallocate network for instance.
Dec 05 13:44:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-fffc265c-764e-46f0-986d-15b8a47e7391 req-a0414b57-34d2-4f08-88bc-72d739f518b1 service nova] [instance: ea52330e-ed18-4c84-bd28-ca464c968ebf] Received event network-vif-deleted-e298c0ed-2f03-4558-8a92-e6172b076cfe {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:17 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:44:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:44:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:17 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Deleted allocations for instance ea52330e-ed18-4c84-bd28-ca464c968ebf
Dec 05 13:44:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8be1a33d-4c8e-4f17-ae77-f3b89dbd7d69 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "ea52330e-ed18-4c84-bd28-ca464c968ebf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:44:18 user nova-compute[75233]: INFO nova.compute.claims [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Claim successful on node user
Dec 05 13:44:18 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:44:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.policy [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5414614ea59f4b26938bf55a492e5ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405f4ac4b28d405fb6f71f29c6557517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:44:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Creating image(s)
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "/opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "/opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "/opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk 1073741824" returned: 0 in 0.065s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:44:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Cannot resize image /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Ensure instance console log exists: /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Successfully created port: 5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Successfully updated port: 5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-changed-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Refreshing instance network info cache due to event network-changed-5d515d32-8096-4b30-b4f7-caee81103ded. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Instance network_info: |[{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Refreshing network info cache for port 5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Start _get_guest_xml network_info=[{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:44:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:44:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-33407165',display_name='tempest-ServerActionsTestOtherA-server-33407165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-33407165',id=17,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-lg5biu8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=bda94a77-e19a-4ea0-88ca-19c86689cd0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'pci_devices' on Instance uuid bda94a77-e19a-4ea0-88ca-19c86689cd0b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:44:21 user nova-compute[75233]:   <uuid>bda94a77-e19a-4ea0-88ca-19c86689cd0b</uuid>
Dec 05 13:44:21 user nova-compute[75233]:   <name>instance-00000011</name>
Dec 05 13:44:21 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:44:21 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:44:21 user nova-compute[75233]:   <metadata>
Dec 05 13:44:21 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:44:21 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:44:21 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherA-server-33407165</nova:name>
Dec 05 13:44:21 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:44:21</nova:creationTime>
Dec 05 13:44:21 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:44:21 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:44:21 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:44:21 user nova-compute[75233]:       <nova:owner>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:user uuid="5414614ea59f4b26938bf55a492e5ddd">tempest-ServerActionsTestOtherA-875899137-project-member</nova:user>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:project uuid="405f4ac4b28d405fb6f71f29c6557517">tempest-ServerActionsTestOtherA-875899137</nova:project>
Dec 05 13:44:21 user nova-compute[75233]:       </nova:owner>
Dec 05 13:44:21 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:44:21 user nova-compute[75233]:       <nova:ports>
Dec 05 13:44:21 user nova-compute[75233]:         <nova:port uuid="5d515d32-8096-4b30-b4f7-caee81103ded">
Dec 05 13:44:21 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 13:44:21 user nova-compute[75233]:         </nova:port>
Dec 05 13:44:21 user nova-compute[75233]:       </nova:ports>
Dec 05 13:44:21 user nova-compute[75233]:     </nova:instance>
Dec 05 13:44:21 user nova-compute[75233]:   </metadata>
Dec 05 13:44:21 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:44:21 user nova-compute[75233]:     <system>
Dec 05 13:44:21 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:44:21 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:44:21 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:44:21 user nova-compute[75233]:       <entry name="serial">bda94a77-e19a-4ea0-88ca-19c86689cd0b</entry>
Dec 05 13:44:21 user nova-compute[75233]:       <entry name="uuid">bda94a77-e19a-4ea0-88ca-19c86689cd0b</entry>
Dec 05 13:44:21 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:44:21 user nova-compute[75233]:     </system>
Dec 05 13:44:21 user nova-compute[75233]:   </sysinfo>
Dec 05 13:44:21 user nova-compute[75233]:   <os>
Dec 05 13:44:21 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:44:21 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:44:21 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:44:21 user nova-compute[75233]:   </os>
Dec 05 13:44:21 user nova-compute[75233]:   <features>
Dec 05 13:44:21 user nova-compute[75233]:     <acpi/>
Dec 05 13:44:21 user nova-compute[75233]:     <apic/>
Dec 05 13:44:21 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:44:21 user nova-compute[75233]:   </features>
Dec 05 13:44:21 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:44:21 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:44:21 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:44:21 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:44:21 user nova-compute[75233]:   </clock>
Dec 05 13:44:21 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:44:21 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:44:21 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:44:21 user nova-compute[75233]:   </cpu>
Dec 05 13:44:21 user nova-compute[75233]:   <devices>
Dec 05 13:44:21 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:44:21 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:44:21 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk"/>
Dec 05 13:44:21 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:44:21 user nova-compute[75233]:     </disk>
Dec 05 13:44:21 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:44:21 user nova-compute[75233]:       <mac address="fa:16:3e:f7:cb:7b"/>
Dec 05 13:44:21 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:44:21 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:44:21 user nova-compute[75233]:       <target dev="tap5d515d32-80"/>
Dec 05 13:44:21 user nova-compute[75233]:     </interface>
Dec 05 13:44:21 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:44:21 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/console.log" append="off"/>
Dec 05 13:44:21 user nova-compute[75233]:     </serial>
Dec 05 13:44:21 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:44:21 user nova-compute[75233]:     <video>
Dec 05 13:44:21 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:44:21 user nova-compute[75233]:     </video>
Dec 05 13:44:21 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:44:21 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:44:21 user nova-compute[75233]:     </rng>
Dec 05 13:44:21 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:44:21 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:44:21 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:44:21 user nova-compute[75233]:     </memballoon>
Dec 05 13:44:21 user nova-compute[75233]:   </devices>
Dec 05 13:44:21 user nova-compute[75233]: </domain>
Dec 05 13:44:21 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-33407165',display_name='tempest-ServerActionsTestOtherA-server-33407165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-33407165',id=17,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-lg5biu8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=bda94a77-e19a-4ea0-88ca-19c86689cd0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG os_vif [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2aa3a54-fcb7-5ec3-8c2d-440b98241859', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d515d32-80, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d515d32-80, col_values=(('qos', UUID('d9c98bea-f4a6-4dd9-b550-a72b49bd284a')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d515d32-80, col_values=(('external_ids', {'iface-id': '5d515d32-8096-4b30-b4f7-caee81103ded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:cb:7b', 'vm-uuid': 'bda94a77-e19a-4ea0-88ca-19c86689cd0b'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:21 user nova-compute[75233]: INFO os_vif [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80')
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No VIF found with MAC fa:16:3e:f7:cb:7b, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated VIF entry in instance network info cache for port 5d515d32-8096-4b30-b4f7-caee81103ded. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG nova.network.neutron [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8ad10e82-71bb-468a-9a4a-619b56272cee req-b6723060-d0e1-40e2-90c2-84362b34d7ef service nova] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-d1c33ffc-e7c6-4e12-b09b-f26ee7800bbc req-c1a83439-7bff-4f93-a575-912b41e28e90 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1c33ffc-e7c6-4e12-b09b-f26ee7800bbc req-c1a83439-7bff-4f93-a575-912b41e28e90 service nova] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1c33ffc-e7c6-4e12-b09b-f26ee7800bbc req-c1a83439-7bff-4f93-a575-912b41e28e90 service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1c33ffc-e7c6-4e12-b09b-f26ee7800bbc req-c1a83439-7bff-4f93-a575-912b41e28e90 service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-d1c33ffc-e7c6-4e12-b09b-f26ee7800bbc req-c1a83439-7bff-4f93-a575-912b41e28e90 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] No waiting events found dispatching network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:23 user nova-compute[75233]: WARNING nova.compute.manager [req-d1c33ffc-e7c6-4e12-b09b-f26ee7800bbc req-c1a83439-7bff-4f93-a575-912b41e28e90 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received unexpected event network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded for instance with vm_state building and task_state spawning.
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-ba4f22e4-c3c6-4bee-a879-c7eb94cce791 req-8bdfb878-2d79-450b-aefe-f0f7cca2acee service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ba4f22e4-c3c6-4bee-a879-c7eb94cce791 req-8bdfb878-2d79-450b-aefe-f0f7cca2acee service nova] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ba4f22e4-c3c6-4bee-a879-c7eb94cce791 req-8bdfb878-2d79-450b-aefe-f0f7cca2acee service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ba4f22e4-c3c6-4bee-a879-c7eb94cce791 req-8bdfb878-2d79-450b-aefe-f0f7cca2acee service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-ba4f22e4-c3c6-4bee-a879-c7eb94cce791 req-8bdfb878-2d79-450b-aefe-f0f7cca2acee service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] No waiting events found dispatching network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:25 user nova-compute[75233]: WARNING nova.compute.manager [req-ba4f22e4-c3c6-4bee-a879-c7eb94cce791 req-8bdfb878-2d79-450b-aefe-f0f7cca2acee service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received unexpected event network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded for instance with vm_state building and task_state spawning.
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:44:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Instance spawned successfully.
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:25 user nova-compute[75233]: INFO nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Took 6.59 seconds to spawn the instance on the hypervisor.
Dec 05 13:44:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:44:25 user nova-compute[75233]: INFO nova.compute.manager [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Took 7.43 seconds to build instance.
Dec 05 13:44:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c07b026-25c9-4591-8f38-654e94d73ed7 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.542s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:44:28 user nova-compute[75233]: INFO nova.compute.claims [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Claim successful on node user
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:44:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:44:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG nova.policy [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6a3445087d842fc9279e2472759bf1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14235050c7d84ebb8ff12ff245c35fec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:44:29 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Creating image(s)
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.209s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.211s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk 1073741824" returned: 0 in 0.059s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.242s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:29 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Successfully created port: 99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Cannot resize image /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Ensure instance console log exists: /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Successfully updated port: 99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-changed-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Refreshing instance network info cache due to event network-changed-99da560f-01fc-4f4c-81f8-7d3a72dc8d45. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance network_info: |[{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.neutron [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Refreshing network info cache for port 99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start _get_guest_xml network_info=[{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:44:31 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:44:31 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'pci_devices' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:44:31 user nova-compute[75233]:   <uuid>47d20f82-0294-43b9-97a3-7ae8c564d08d</uuid>
Dec 05 13:44:31 user nova-compute[75233]:   <name>instance-00000012</name>
Dec 05 13:44:31 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:44:31 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:44:31 user nova-compute[75233]:   <metadata>
Dec 05 13:44:31 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:44:31 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:44:31 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeTestJSON-server-460475358</nova:name>
Dec 05 13:44:31 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:44:31</nova:creationTime>
Dec 05 13:44:31 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:44:31 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:44:31 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:44:31 user nova-compute[75233]:       <nova:owner>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:user uuid="a6a3445087d842fc9279e2472759bf1f">tempest-AttachVolumeTestJSON-1807043870-project-member</nova:user>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:project uuid="14235050c7d84ebb8ff12ff245c35fec">tempest-AttachVolumeTestJSON-1807043870</nova:project>
Dec 05 13:44:31 user nova-compute[75233]:       </nova:owner>
Dec 05 13:44:31 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:44:31 user nova-compute[75233]:       <nova:ports>
Dec 05 13:44:31 user nova-compute[75233]:         <nova:port uuid="99da560f-01fc-4f4c-81f8-7d3a72dc8d45">
Dec 05 13:44:31 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 13:44:31 user nova-compute[75233]:         </nova:port>
Dec 05 13:44:31 user nova-compute[75233]:       </nova:ports>
Dec 05 13:44:31 user nova-compute[75233]:     </nova:instance>
Dec 05 13:44:31 user nova-compute[75233]:   </metadata>
Dec 05 13:44:31 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:44:31 user nova-compute[75233]:     <system>
Dec 05 13:44:31 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:44:31 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:44:31 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:44:31 user nova-compute[75233]:       <entry name="serial">47d20f82-0294-43b9-97a3-7ae8c564d08d</entry>
Dec 05 13:44:31 user nova-compute[75233]:       <entry name="uuid">47d20f82-0294-43b9-97a3-7ae8c564d08d</entry>
Dec 05 13:44:31 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:44:31 user nova-compute[75233]:     </system>
Dec 05 13:44:31 user nova-compute[75233]:   </sysinfo>
Dec 05 13:44:31 user nova-compute[75233]:   <os>
Dec 05 13:44:31 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:44:31 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:44:31 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:44:31 user nova-compute[75233]:   </os>
Dec 05 13:44:31 user nova-compute[75233]:   <features>
Dec 05 13:44:31 user nova-compute[75233]:     <acpi/>
Dec 05 13:44:31 user nova-compute[75233]:     <apic/>
Dec 05 13:44:31 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:44:31 user nova-compute[75233]:   </features>
Dec 05 13:44:31 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:44:31 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:44:31 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:44:31 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:44:31 user nova-compute[75233]:   </clock>
Dec 05 13:44:31 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:44:31 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:44:31 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:44:31 user nova-compute[75233]:   </cpu>
Dec 05 13:44:31 user nova-compute[75233]:   <devices>
Dec 05 13:44:31 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:44:31 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:44:31 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk"/>
Dec 05 13:44:31 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:44:31 user nova-compute[75233]:     </disk>
Dec 05 13:44:31 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:44:31 user nova-compute[75233]:       <mac address="fa:16:3e:d5:3a:57"/>
Dec 05 13:44:31 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:44:31 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:44:31 user nova-compute[75233]:       <target dev="tap99da560f-01"/>
Dec 05 13:44:31 user nova-compute[75233]:     </interface>
Dec 05 13:44:31 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:44:31 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/console.log" append="off"/>
Dec 05 13:44:31 user nova-compute[75233]:     </serial>
Dec 05 13:44:31 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:44:31 user nova-compute[75233]:     <video>
Dec 05 13:44:31 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:44:31 user nova-compute[75233]:     </video>
Dec 05 13:44:31 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:44:31 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:44:31 user nova-compute[75233]:     </rng>
Dec 05 13:44:31 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:44:31 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:44:31 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:44:31 user nova-compute[75233]:     </memballoon>
Dec 05 13:44:31 user nova-compute[75233]:   </devices>
Dec 05 13:44:31 user nova-compute[75233]: </domain>
Dec 05 13:44:31 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG os_vif [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c21130e1-59cf-58e9-9a14-1dd30573fb0a', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99da560f-01, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99da560f-01, col_values=(('qos', UUID('2335ab94-0726-40fb-a3de-e99de7d54510')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99da560f-01, col_values=(('external_ids', {'iface-id': '99da560f-01fc-4f4c-81f8-7d3a72dc8d45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:3a:57', 'vm-uuid': '47d20f82-0294-43b9-97a3-7ae8c564d08d'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:31 user nova-compute[75233]: INFO os_vif [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01')
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:44:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No VIF found with MAC fa:16:3e:d5:3a:57, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:44:32 user nova-compute[75233]: DEBUG nova.network.neutron [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updated VIF entry in instance network info cache for port 99da560f-01fc-4f4c-81f8-7d3a72dc8d45. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:44:32 user nova-compute[75233]: DEBUG nova.network.neutron [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a73ba7a0-7bf5-4ec8-949b-f3cd5896c304 req-c6520d6b-4100-42e1-8507-cbe869bd1e99 service nova] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-1ca7faaf-e3ab-4070-91fd-140160a3605c req-7dd44443-412f-45eb-9d36-38174cad5863 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1ca7faaf-e3ab-4070-91fd-140160a3605c req-7dd44443-412f-45eb-9d36-38174cad5863 service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1ca7faaf-e3ab-4070-91fd-140160a3605c req-7dd44443-412f-45eb-9d36-38174cad5863 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1ca7faaf-e3ab-4070-91fd-140160a3605c req-7dd44443-412f-45eb-9d36-38174cad5863 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-1ca7faaf-e3ab-4070-91fd-140160a3605c req-7dd44443-412f-45eb-9d36-38174cad5863 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:33 user nova-compute[75233]: WARNING nova.compute.manager [req-1ca7faaf-e3ab-4070-91fd-140160a3605c req-7dd44443-412f-45eb-9d36-38174cad5863 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state building and task_state spawning.
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:44:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance spawned successfully.
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-6b542141-f9dc-4ce8-840b-7fb4f86659a3 req-a7e811c7-7ed9-4ead-a697-0034cdcc0480 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6b542141-f9dc-4ce8-840b-7fb4f86659a3 req-a7e811c7-7ed9-4ead-a697-0034cdcc0480 service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6b542141-f9dc-4ce8-840b-7fb4f86659a3 req-a7e811c7-7ed9-4ead-a697-0034cdcc0480 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6b542141-f9dc-4ce8-840b-7fb4f86659a3 req-a7e811c7-7ed9-4ead-a697-0034cdcc0480 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-6b542141-f9dc-4ce8-840b-7fb4f86659a3 req-a7e811c7-7ed9-4ead-a697-0034cdcc0480 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:35 user nova-compute[75233]: WARNING nova.compute.manager [req-6b542141-f9dc-4ce8-840b-7fb4f86659a3 req-a7e811c7-7ed9-4ead-a697-0034cdcc0480 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state building and task_state spawning.
Dec 05 13:44:35 user nova-compute[75233]: INFO nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Took 6.57 seconds to spawn the instance on the hypervisor.
Dec 05 13:44:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:44:35 user nova-compute[75233]: INFO nova.compute.manager [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Took 7.49 seconds to build instance.
Dec 05 13:44:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee3308bf-f55f-49ab-8bfd-ceb4d8817063 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.610s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 13:44:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 13:44:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:41 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:41 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:44:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:44:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:44:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7784MB free_disk=25.184738159179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 63978594-a36a-47f8-a596-4e6c1b965e7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance d1462005-63a7-4b1e-b636-2f0daa7d5700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:44:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:44:48 user nova-compute[75233]: INFO nova.compute.manager [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Unrescuing
Dec 05 13:44:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.228s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 13:44:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG nova.objects.instance [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'flavor' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-5353e021-e769-462f-979e-05f4bb37ce00 req-85710c66-981c-4c50-8b0d-a169475fb422 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5353e021-e769-462f-979e-05f4bb37ce00 req-85710c66-981c-4c50-8b0d-a169475fb422 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5353e021-e769-462f-979e-05f4bb37ce00 req-85710c66-981c-4c50-8b0d-a169475fb422 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5353e021-e769-462f-979e-05f4bb37ce00 req-85710c66-981c-4c50-8b0d-a169475fb422 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-5353e021-e769-462f-979e-05f4bb37ce00 req-85710c66-981c-4c50-8b0d-a169475fb422 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:49 user nova-compute[75233]: WARNING nova.compute.manager [req-5353e021-e769-462f-979e-05f4bb37ce00 req-85710c66-981c-4c50-8b0d-a169475fb422 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:44:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:44:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:44:50 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance destroyed successfully.
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing instance network info cache due to event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.network.neutron [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:44:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG nova.network.neutron [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updated VIF entry in instance network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG nova.network.neutron [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-39439683-8a7f-4b0c-a048-4dd3af757918 req-c6a75ab7-0e71-4e10-b72b-4bc0d8032f7c service nova] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-acbafc78-e276-4de3-bac3-162d0d6cea97 req-23f2b972-25b3-4436-9299-0f4c05631554 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-acbafc78-e276-4de3-bac3-162d0d6cea97 req-23f2b972-25b3-4436-9299-0f4c05631554 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-acbafc78-e276-4de3-bac3-162d0d6cea97 req-23f2b972-25b3-4436-9299-0f4c05631554 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-acbafc78-e276-4de3-bac3-162d0d6cea97 req-23f2b972-25b3-4436-9299-0f4c05631554 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-acbafc78-e276-4de3-bac3-162d0d6cea97 req-23f2b972-25b3-4436-9299-0f4c05631554 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:51 user nova-compute[75233]: WARNING nova.compute.manager [req-acbafc78-e276-4de3-bac3-162d0d6cea97 req-23f2b972-25b3-4436-9299-0f4c05631554 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:44:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing instance network info cache due to event network-changed-ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] Acquiring lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] Acquired lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:44:52 user nova-compute[75233]: DEBUG nova.network.neutron [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Refreshing network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG nova.network.neutron [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updated VIF entry in instance network info cache for port ae30a80c-81bb-4488-87f3-0f7b25393f6d. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG nova.network.neutron [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [{"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5d1a379e-87bf-4810-87b1-4e07e4d5c9c4 req-b95211ff-7045-43b7-bde8-0dc2c9043af2 service nova] Releasing lock "refresh_cache-193e4239-ac4b-42d6-a87b-cb3aff3ed71a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:53 user nova-compute[75233]: WARNING nova.compute.manager [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:44:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:44:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:44:53 user nova-compute[75233]: WARNING nova.compute.manager [req-205ecda5-a7c8-439a-ba41-02a3af8ddb17 req-a38dc245-3a7e-4789-a56e-a1ddb2389c80 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:44:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-54704e13-eb0b-4fd3-95cc-66ad711dc941 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:44:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:44:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-changed-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Refreshing instance network info cache due to event network-changed-217ff3c3-5eed-435e-b7b1-ec6872e83d24. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:45:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:45:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:45:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Refreshing network info cache for port 217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:45:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updated VIF entry in instance network info cache for port 217ff3c3-5eed-435e-b7b1-ec6872e83d24. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:45:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:45:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fb56cc0e-f2e3-4def-9492-e9b6d29030d2 req-36652483-a825-4cfe-9bd8-9b21e7f44747 service nova] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:45:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:10 user nova-compute[75233]: INFO nova.compute.manager [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Terminating instance
Dec 05 13:45:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-040fc0e2-3df4-49a1-881d-6237514e8211 req-4f3ecc22-77cb-4cbb-a11a-7834a7993420 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-vif-unplugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-040fc0e2-3df4-49a1-881d-6237514e8211 req-4f3ecc22-77cb-4cbb-a11a-7834a7993420 service nova] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-040fc0e2-3df4-49a1-881d-6237514e8211 req-4f3ecc22-77cb-4cbb-a11a-7834a7993420 service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-040fc0e2-3df4-49a1-881d-6237514e8211 req-4f3ecc22-77cb-4cbb-a11a-7834a7993420 service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-040fc0e2-3df4-49a1-881d-6237514e8211 req-4f3ecc22-77cb-4cbb-a11a-7834a7993420 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] No waiting events found dispatching network-vif-unplugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:45:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-040fc0e2-3df4-49a1-881d-6237514e8211 req-4f3ecc22-77cb-4cbb-a11a-7834a7993420 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-vif-unplugged-b0eee427-11d4-4575-aeee-33db56579d43 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:45:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Instance destroyed successfully.
Dec 05 13:45:11 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lazy-loading 'resources' on Instance uuid 63978594-a36a-47f8-a596-4e6c1b965e7c {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:39:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-258621968',display_name='tempest-VolumesAdminNegativeTest-server-258621968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-258621968',id=4,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcprkdI0uORrugH/DtKDi7XQ5hNZUCvjMZpn0qOJSClJPaY04Ujn3Q1mTgX+RkpyVjwFy2LWtuCrD8eRWTWjfAYAyaOQ2XsUiB3g5+k2Xd4fXPZ9CESmUN4MQEul6ArdQ==',key_name='tempest-keypair-376334586',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='426a7cafbfd54c23a56c584b9107d871',ramdisk_id='',reservation_id='r-1s41pkxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2110311291',owner_user_name='tempest-VolumesAdminNegativeTest-2110311291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e28e6b2894c844ae864b0283b8824371',uuid=63978594-a36a-47f8-a596-4e6c1b965e7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converting VIF {"id": "b0eee427-11d4-4575-aeee-33db56579d43", "address": "fa:16:3e:03:59:cd", "network": {"id": "91f7bff3-e6a7-44d8-a4db-5bedcaffab3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-765572048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426a7cafbfd54c23a56c584b9107d871", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0eee427-11", "ovs_interfaceid": "b0eee427-11d4-4575-aeee-33db56579d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG os_vif [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0eee427-11, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=782b7dfa-64df-4270-96a9-221d7ffb0866) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:11 user nova-compute[75233]: INFO os_vif [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:59:cd,bridge_name='br-int',has_traffic_filtering=True,id=b0eee427-11d4-4575-aeee-33db56579d43,network=Network(91f7bff3-e6a7-44d8-a4db-5bedcaffab3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0eee427-11')
Dec 05 13:45:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Deleting instance files /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c_del
Dec 05 13:45:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Deletion of /opt/stack/data/nova/instances/63978594-a36a-47f8-a596-4e6c1b965e7c_del complete
Dec 05 13:45:11 user nova-compute[75233]: INFO nova.compute.manager [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 05 13:45:11 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:45:11 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:45:12 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Took 0.98 seconds to deallocate network for instance.
Dec 05 13:45:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-89d20c91-162f-4f08-b952-2974b535865e req-d3d9044e-17c8-4e1d-b961-6f96deaf17fc service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-vif-deleted-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:12 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Deleted allocations for instance 63978594-a36a-47f8-a596-4e6c1b965e7c
Dec 05 13:45:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-ce1c6404-4c7b-4b44-a603-7e4123265b74 req-71f24df5-4f4c-447a-8357-98fddf32b944 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received event network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ce1c6404-4c7b-4b44-a603-7e4123265b74 req-71f24df5-4f4c-447a-8357-98fddf32b944 service nova] Acquiring lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ce1c6404-4c7b-4b44-a603-7e4123265b74 req-71f24df5-4f4c-447a-8357-98fddf32b944 service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ce1c6404-4c7b-4b44-a603-7e4123265b74 req-71f24df5-4f4c-447a-8357-98fddf32b944 service nova] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-ce1c6404-4c7b-4b44-a603-7e4123265b74 req-71f24df5-4f4c-447a-8357-98fddf32b944 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] No waiting events found dispatching network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:45:12 user nova-compute[75233]: WARNING nova.compute.manager [req-ce1c6404-4c7b-4b44-a603-7e4123265b74 req-71f24df5-4f4c-447a-8357-98fddf32b944 service nova] [instance: 63978594-a36a-47f8-a596-4e6c1b965e7c] Received unexpected event network-vif-plugged-b0eee427-11d4-4575-aeee-33db56579d43 for instance with vm_state deleted and task_state None.
Dec 05 13:45:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ee37f3ba-44b1-4431-bd6b-bd2861890f17 tempest-VolumesAdminNegativeTest-2110311291 tempest-VolumesAdminNegativeTest-2110311291-project-member] Lock "63978594-a36a-47f8-a596-4e6c1b965e7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:16 user nova-compute[75233]: INFO nova.compute.manager [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Unrescuing
Dec 05 13:45:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:45:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:45:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'flavor' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-3b8c015b-fc11-4539-8c1d-87d09ead5b1f req-3492c77f-d154-4707-964e-e37007cb2ae6 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3b8c015b-fc11-4539-8c1d-87d09ead5b1f req-3492c77f-d154-4707-964e-e37007cb2ae6 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3b8c015b-fc11-4539-8c1d-87d09ead5b1f req-3492c77f-d154-4707-964e-e37007cb2ae6 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3b8c015b-fc11-4539-8c1d-87d09ead5b1f req-3492c77f-d154-4707-964e-e37007cb2ae6 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-3b8c015b-fc11-4539-8c1d-87d09ead5b1f req-3492c77f-d154-4707-964e-e37007cb2ae6 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:45:17 user nova-compute[75233]: WARNING nova.compute.manager [req-3b8c015b-fc11-4539-8c1d-87d09ead5b1f req-3492c77f-d154-4707-964e-e37007cb2ae6 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:45:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance destroyed successfully.
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:45:19 user nova-compute[75233]: WARNING nova.compute.manager [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:45:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:45:19 user nova-compute[75233]: WARNING nova.compute.manager [req-2f9c2ce2-72ec-4298-8ba8-02ebef046073 req-919ebb0a-b905-4e6b-9d64-6d4a3ab48d93 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:45:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid bda94a77-e19a-4ea0-88ca-19c86689cd0b {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: INFO nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] During sync_power_state the instance has a pending task (unrescuing). Skip.
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-a439a877-90a0-40e5-a627-e873a088a252 req-e3f54817-f2c8-4c53-a182-83031877eeff service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a439a877-90a0-40e5-a627-e873a088a252 req-e3f54817-f2c8-4c53-a182-83031877eeff service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a439a877-90a0-40e5-a627-e873a088a252 req-e3f54817-f2c8-4c53-a182-83031877eeff service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a439a877-90a0-40e5-a627-e873a088a252 req-e3f54817-f2c8-4c53-a182-83031877eeff service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-a439a877-90a0-40e5-a627-e873a088a252 req-e3f54817-f2c8-4c53-a182-83031877eeff service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:45:21 user nova-compute[75233]: WARNING nova.compute.manager [req-a439a877-90a0-40e5-a627-e873a088a252 req-e3f54817-f2c8-4c53-a182-83031877eeff service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:45:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2f3b894-670f-45d9-aa71-fd5be3d7a136 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:45:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:22 user nova-compute[75233]: INFO nova.compute.manager [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Detaching volume 41ad45d8-0292-4962-82f2-9e815f7a9ab6
Dec 05 13:45:22 user nova-compute[75233]: INFO nova.virt.block_device [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Attempting to driver detach volume 41ad45d8-0292-4962-82f2-9e815f7a9ab6 from mountpoint /dev/vdb
Dec 05 13:45:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Attempting to detach device vdb from instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:45:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:45:22 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:45:22 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:45:22 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:45:22 user nova-compute[75233]:   <serial>41ad45d8-0292-4962-82f2-9e815f7a9ab6</serial>
Dec 05 13:45:22 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:45:22 user nova-compute[75233]: </disk>
Dec 05 13:45:22 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:45:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Successfully detached device vdb from instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a from the persistent domain config.
Dec 05 13:45:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:45:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:45:22 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:45:22 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:45:22 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:45:22 user nova-compute[75233]:   <serial>41ad45d8-0292-4962-82f2-9e815f7a9ab6</serial>
Dec 05 13:45:22 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:45:22 user nova-compute[75233]: </disk>
Dec 05 13:45:22 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:45:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:45:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-changed-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:45:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Refreshing instance network info cache due to event network-changed-dc658684-4b4c-4829-8d3d-ed1e44aeb5be. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:45:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] Acquiring lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:45:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] Acquired lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:45:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Refreshing network info cache for port dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'flavor' on Instance uuid d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:45:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Ignoring supplied device name: /dev/vdb
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:26 user nova-compute[75233]: INFO nova.compute.manager [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Attaching volume 597ff61f-4508-47e6-b266-da1edfacd045 to /dev/vdb
Dec 05 13:45:26 user nova-compute[75233]: DEBUG os_brick.utils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c40e6-2c98-4c98-93b1-2a6be64f7953]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a2e8a7-7cf3-4a5a-bdfd-807e0f307326]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc4ca49-506d-4392-8269-18de6ddcd2c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4f6bfa-011a-408e-b4c6-bfc48fe9fd53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:45:26 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3679181-7e07-479c-894c-68e7c75f7e53]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG os_brick.utils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updating existing volume attachment record: 05eac400-851f-4548-b067-d80dbc8bd403 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updated VIF entry in instance network info cache for port dc658684-4b4c-4829-8d3d-ed1e44aeb5be. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updating instance_info_cache with network_info: [{"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:45:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-50edcd9f-2ba9-47d4-aae0-66806fe872f6 req-304aa05a-b503-4d89-aa39-e281e6e9ad4e service nova] Releasing lock "refresh_cache-d1462005-63a7-4b1e-b636-2f0daa7d5700" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:45:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:45:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBsYKAUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:45:36 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:45:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:45:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:45:36 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:45:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:45:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:45:36 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:45:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce83fb0-96cc-461c-b42b-50dab6fd8dbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:45:37 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93045a04-937d-4928-a194-7a534048a994]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045] added
Dec 05 13:45:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd818a-165d-4944-be44-e142ce377303]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5ebb58-05cc-4ab3-bc80-a06c02930864]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBsYKAUg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBsYKAUg" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da17b9-03b9-48a4-a714-482742a147a8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RBsYKAUg'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0439f4ab-accb-43eb-8d85-e8e1842edbdd]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea481a39-e96f-458b-9b32-a235fdabffba]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:45:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:45:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee886b0-a9c0-4116-9f2b-c80ad22cf7a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260]
Dec 05 13:45:37 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260] successful.
Dec 05 13:45:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[156099d2-8ce1-4b60-8190-f7b7e89b80b2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c838ef65-529b-4055-85ee-2b2490ed737d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:45:37 user nova-compute[75233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)
Dec 05 13:45:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:45:37 user nova-compute[75233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)
Dec 05 13:45:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[957cf768-baf4-46df-9ea7-9f06d310a15f]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:45:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBsYKAUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23130653835333233', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130653835333233', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'flavor' on Instance uuid d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:45:38 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:45:38 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:45:38 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:45:38 user nova-compute[75233]:   <serial>597ff61f-4508-47e6-b266-da1edfacd045</serial>
Dec 05 13:45:38 user nova-compute[75233]: </disk>
Dec 05 13:45:38 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] No VIF found with MAC fa:16:3e:1b:43:63, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:45:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-39ba6ddf-c1ff-4876-a8ad-78b3b991f444 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.494s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:41 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:41 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:42 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a is timed out.
Dec 05 13:45:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Successfully detached device vdb from instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a from the live domain config.
Dec 05 13:45:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JenvmMyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:45:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[55762be7-1774-4405-9af9-c40fec57f3c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:45:43 user nova-compute[75233]: No targets found.
Dec 05 13:45:43 user nova-compute[75233]: iSNS:
Dec 05 13:45:43 user nova-compute[75233]: No targets found.
Dec 05 13:45:43 user nova-compute[75233]: STATIC:
Dec 05 13:45:43 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045
Dec 05 13:45:43 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:45:43 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:45:43 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6
Dec 05 13:45:43 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:45:43 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:45:43 user nova-compute[75233]: FIRMWARE:
Dec 05 13:45:43 user nova-compute[75233]: No targets found.
Dec 05 13:45:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:45:43 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:45:43 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6fc06-0bab-4b74-b6fa-239babcf9b4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9999398b-9fc8-4bd4-abd7-d6f1cf31039d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:45:43 user nova-compute[75233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)
Dec 05 13:45:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 (non-flash)
Dec 05 13:45:43 user nova-compute[75233]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)
Dec 05 13:45:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586a8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efafa00c-d135-4fa0-b11b-a861e03b4d1f]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7065c-2868-45ec-9de0-ca2ce038a190]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c21e811-e658-451e-a1bc-1f0b6a1cb495]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[90440835-e3aa-43bf-aa1a-1f682661a55c]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e4b69-32e7-46ab-8668-e516c485f158]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4237d962-d51d-43a1-a6bb-746b7f47bb18]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260]
Dec 05 13:45:43 user nova-compute[75233]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6, portal: 172.16.0.220,3260] successful.
Dec 05 13:45:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41ad45d8-0292-4962-82f2-9e815f7a9ab6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[29957ec1-6da1-4661-8803-6609a875cd26]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] <== disconnect_volume: return (333ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'flavor' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:45:46 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:45:46 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=25.15298080444336GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6fb06177-a612-4eb3-9273-64fc3bb38df0 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.353s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance d1462005-63a7-4b1e-b636-2f0daa7d5700 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:45:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:45:47 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:45:47 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:45:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:45:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:45:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:45:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:45:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:45:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:45:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:45:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:45:52 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:45:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:45:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:45:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:45:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:04 user nova-compute[75233]: INFO nova.compute.manager [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Detaching volume 597ff61f-4508-47e6-b266-da1edfacd045
Dec 05 13:46:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:04 user nova-compute[75233]: INFO nova.virt.block_device [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Attempting to driver detach volume 597ff61f-4508-47e6-b266-da1edfacd045 from mountpoint /dev/vdb
Dec 05 13:46:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Attempting to detach device vdb from instance d1462005-63a7-4b1e-b636-2f0daa7d5700 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:46:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:46:04 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:46:04 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:46:04 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:46:04 user nova-compute[75233]:   <serial>597ff61f-4508-47e6-b266-da1edfacd045</serial>
Dec 05 13:46:04 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:46:04 user nova-compute[75233]: </disk>
Dec 05 13:46:04 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:46:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully detached device vdb from instance d1462005-63a7-4b1e-b636-2f0daa7d5700 from the persistent domain config.
Dec 05 13:46:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1462005-63a7-4b1e-b636-2f0daa7d5700 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:46:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:46:04 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:46:04 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:46:04 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:46:04 user nova-compute[75233]:   <serial>597ff61f-4508-47e6-b266-da1edfacd045</serial>
Dec 05 13:46:04 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:46:04 user nova-compute[75233]: </disk>
Dec 05 13:46:04 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:46:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:46:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-changed-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Refreshing instance network info cache due to event network-changed-5d515d32-8096-4b30-b4f7-caee81103ded. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:46:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Refreshing network info cache for port 5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:46:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated VIF entry in instance network info cache for port 5d515d32-8096-4b30-b4f7-caee81103ded. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:46:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e0dfbb62-769f-4a8b-91aa-728f8a247bef req-56a8c342-6538-4eb5-8c6c-df03245d18cb service nova] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:13 user nova-compute[75233]: INFO nova.compute.manager [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Terminating instance
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-69e7df29-c388-4950-ba6b-359e8730eac4 req-29c4f6fb-b826-4982-8828-3ceda0988450 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69e7df29-c388-4950-ba6b-359e8730eac4 req-29c4f6fb-b826-4982-8828-3ceda0988450 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69e7df29-c388-4950-ba6b-359e8730eac4 req-29c4f6fb-b826-4982-8828-3ceda0988450 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69e7df29-c388-4950-ba6b-359e8730eac4 req-29c4f6fb-b826-4982-8828-3ceda0988450 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-69e7df29-c388-4950-ba6b-359e8730eac4 req-29c4f6fb-b826-4982-8828-3ceda0988450 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-69e7df29-c388-4950-ba6b-359e8730eac4 req-29c4f6fb-b826-4982-8828-3ceda0988450 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Instance destroyed successfully.
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.objects.instance [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lazy-loading 'resources' on Instance uuid 193e4239-ac4b-42d6-a87b-cb3aff3ed71a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-618450068',display_name='tempest-ServerStableDeviceRescueTest-server-618450068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-618450068',id=3,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCyvHhzGmozq6uruCNlWPIfLj6uVQK8EP7eWv5aXgCSUtxhFvniepOEQrmaNb6W5GNVSyeRLN51P6XksSXhXlMNxIL4hzl4fOrJYtVmGzfArN0YnViqm0PItIXPSLIeFA==',key_name='tempest-keypair-777986006',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='068310b985b44818bb545496e9c20239',ramdisk_id='',reservation_id='r-a01ctks7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-507168574',owner_user_name='tempest-ServerStableDeviceRescueTest-507168574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef50a1eea44e9bbac2fdb4b32a8776',uuid=193e4239-ac4b-42d6-a87b-cb3aff3ed71a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converting VIF {"id": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "address": "fa:16:3e:b2:7c:53", "network": {"id": "39a1620f-f6d7-4f66-a1de-2636fbbd1ec4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1688177769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "068310b985b44818bb545496e9c20239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae30a80c-81", "ovs_interfaceid": "ae30a80c-81bb-4488-87f3-0f7b25393f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG os_vif [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae30a80c-81, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=240b9ca7-2a85-4a72-8b77-c86bdb482a52) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:13 user nova-compute[75233]: INFO os_vif [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:7c:53,bridge_name='br-int',has_traffic_filtering=True,id=ae30a80c-81bb-4488-87f3-0f7b25393f6d,network=Network(39a1620f-f6d7-4f66-a1de-2636fbbd1ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae30a80c-81')
Dec 05 13:46:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Deleting instance files /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a_del
Dec 05 13:46:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Deletion of /opt/stack/data/nova/instances/193e4239-ac4b-42d6-a87b-cb3aff3ed71a_del complete
Dec 05 13:46:14 user nova-compute[75233]: INFO nova.compute.manager [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 05 13:46:14 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:15 user nova-compute[75233]: WARNING nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state deleting.
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:15 user nova-compute[75233]: WARNING nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state deleting.
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:15 user nova-compute[75233]: WARNING nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state deleting.
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-unplugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Acquiring lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] No waiting events found dispatching network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:15 user nova-compute[75233]: WARNING nova.compute.manager [req-e59ace84-a775-46ce-a6a3-1e4afd700c26 req-6af16da4-16bf-4107-9547-d3867eb03c07 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received unexpected event network-vif-plugged-ae30a80c-81bb-4488-87f3-0f7b25393f6d for instance with vm_state active and task_state deleting.
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:15 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Took 1.75 seconds to deallocate network for instance.
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-6d18548b-4111-4468-a866-820acfdda8d6 req-766a7a16-302e-4ec8-8d8e-5dae83190993 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Received event network-vif-deleted-ae30a80c-81bb-4488-87f3-0f7b25393f6d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:15 user nova-compute[75233]: INFO nova.compute.manager [req-6d18548b-4111-4468-a866-820acfdda8d6 req-766a7a16-302e-4ec8-8d8e-5dae83190993 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Neutron deleted interface ae30a80c-81bb-4488-87f3-0f7b25393f6d; detaching it from the instance and deleting it from the info cache
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-6d18548b-4111-4468-a866-820acfdda8d6 req-766a7a16-302e-4ec8-8d8e-5dae83190993 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-6d18548b-4111-4468-a866-820acfdda8d6 req-766a7a16-302e-4ec8-8d8e-5dae83190993 service nova] [instance: 193e4239-ac4b-42d6-a87b-cb3aff3ed71a] Detach interface failed, port_id=ae30a80c-81bb-4488-87f3-0f7b25393f6d, reason: Instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:16 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:46:16 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:46:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:16 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Deleted allocations for instance 193e4239-ac4b-42d6-a87b-cb3aff3ed71a
Dec 05 13:46:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-73822650-b579-4787-b0fa-7bfd4c799533 tempest-ServerStableDeviceRescueTest-507168574 tempest-ServerStableDeviceRescueTest-507168574-project-member] Lock "193e4239-ac4b-42d6-a87b-cb3aff3ed71a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.292s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-changed-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Refreshing instance network info cache due to event network-changed-99da560f-01fc-4f4c-81f8-7d3a72dc8d45. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Refreshing network info cache for port 99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updated VIF entry in instance network info cache for port 99da560f-01fc-4f4c-81f8-7d3a72dc8d45. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG nova.network.neutron [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eba8e4b1-e753-446e-bd77-a31820fcff88 req-8c3c5326-f485-4ab9-8f9b-74f4ac80c908 service nova] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:46:21 user nova-compute[75233]: INFO nova.compute.claims [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Claim successful on node user
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:46:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.policy [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf813870948a4870b545b0e886df6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2ce2c635bf41cb858f09061d5491bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:46:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Creating image(s)
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "/opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "/opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "/opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:46:22 user nova-compute[75233]: INFO nova.compute.claims [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Claim successful on node user
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk 1073741824" returned: 0 in 0.058s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.objects.instance [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Cannot resize image /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Ensure instance console log exists: /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:23 user nova-compute[75233]: INFO nova.compute.manager [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Attaching volume 1c48c470-ff2e-4d63-9fcf-9199c5a5741c to /dev/vdb
Dec 05 13:46:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Successfully created port: fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG os_brick.utils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.policy [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '933c647e356948fc9c47ca719629fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e17ec7e000470e9c2a0d58119f25e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ee47f-439e-4bad-a020-153e3ae9c5f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd60f95-7e33-4f27-96e5-fe87b73c5ad3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c48fcb0-f097-4490-93ea-19eaa793b806]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf81dadd-78b5-47c9-b400-4d6f56053bae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:46:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Creating image(s)
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "/opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "/opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:46:23 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c3264-09a6-4d14-a898-3e29ff49ac80]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG os_brick.utils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating existing volume attachment record: 536f3174-7195-48f8-acef-6ddfa369bca4 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk 1073741824" returned: 0 in 0.060s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Successfully created port: 79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Successfully updated port: fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquired lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-changed-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Refreshing instance network info cache due to event network-changed-fa063bc7-cc2e-44b9-99b5-723c5ce240cf. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] Acquiring lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Cannot resize image /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Ensure instance console log exists: /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updating instance_info_cache with network_info: [{"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Releasing lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Instance network_info: |[{"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] Acquired lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Refreshing network info cache for port fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Start _get_guest_xml network_info=[{"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:46:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:46:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1683810375',display_name='tempest-TestServerVolumeAttachmentScenario-server-1683810375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1683810375',id=19,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqSaVHO8f60RVcpGIEkfGhT9t+LWFG/9rjTmFbkF4pAOdZ3b5tTBnESEF5bqo6LIIwex1OJk/TCZ0fUJkUEpZOQO1YNvkpqMic5Xit5SYfe8E3ENPqn0Xrg/Kffgr1sNg==',key_name='tempest-keypair-55988495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b2ce2c635bf41cb858f09061d5491bc',ramdisk_id='',reservation_id='r-yu50bo6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1500715046',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1500715046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf813870948a4870b545b0e886df6567',uuid=84e303d2-b587-4574-bd33-d682e74289a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Converting VIF {"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'pci_devices' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:46:24 user nova-compute[75233]:   <uuid>84e303d2-b587-4574-bd33-d682e74289a9</uuid>
Dec 05 13:46:24 user nova-compute[75233]:   <name>instance-00000013</name>
Dec 05 13:46:24 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:46:24 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:46:24 user nova-compute[75233]:   <metadata>
Dec 05 13:46:24 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:46:24 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:46:24 user nova-compute[75233]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1683810375</nova:name>
Dec 05 13:46:24 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:46:24</nova:creationTime>
Dec 05 13:46:24 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:46:24 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:46:24 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:46:24 user nova-compute[75233]:       <nova:owner>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:user uuid="cf813870948a4870b545b0e886df6567">tempest-TestServerVolumeAttachmentScenario-1500715046-project-member</nova:user>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:project uuid="8b2ce2c635bf41cb858f09061d5491bc">tempest-TestServerVolumeAttachmentScenario-1500715046</nova:project>
Dec 05 13:46:24 user nova-compute[75233]:       </nova:owner>
Dec 05 13:46:24 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:46:24 user nova-compute[75233]:       <nova:ports>
Dec 05 13:46:24 user nova-compute[75233]:         <nova:port uuid="fa063bc7-cc2e-44b9-99b5-723c5ce240cf">
Dec 05 13:46:24 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:46:24 user nova-compute[75233]:         </nova:port>
Dec 05 13:46:24 user nova-compute[75233]:       </nova:ports>
Dec 05 13:46:24 user nova-compute[75233]:     </nova:instance>
Dec 05 13:46:24 user nova-compute[75233]:   </metadata>
Dec 05 13:46:24 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:46:24 user nova-compute[75233]:     <system>
Dec 05 13:46:24 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:46:24 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:46:24 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:46:24 user nova-compute[75233]:       <entry name="serial">84e303d2-b587-4574-bd33-d682e74289a9</entry>
Dec 05 13:46:24 user nova-compute[75233]:       <entry name="uuid">84e303d2-b587-4574-bd33-d682e74289a9</entry>
Dec 05 13:46:24 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:46:24 user nova-compute[75233]:     </system>
Dec 05 13:46:24 user nova-compute[75233]:   </sysinfo>
Dec 05 13:46:24 user nova-compute[75233]:   <os>
Dec 05 13:46:24 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:46:24 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:46:24 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:46:24 user nova-compute[75233]:   </os>
Dec 05 13:46:24 user nova-compute[75233]:   <features>
Dec 05 13:46:24 user nova-compute[75233]:     <acpi/>
Dec 05 13:46:24 user nova-compute[75233]:     <apic/>
Dec 05 13:46:24 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:46:24 user nova-compute[75233]:   </features>
Dec 05 13:46:24 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:46:24 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:46:24 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:46:24 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:46:24 user nova-compute[75233]:   </clock>
Dec 05 13:46:24 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:46:24 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:46:24 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:46:24 user nova-compute[75233]:   </cpu>
Dec 05 13:46:24 user nova-compute[75233]:   <devices>
Dec 05 13:46:24 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:46:24 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:46:24 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk"/>
Dec 05 13:46:24 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:46:24 user nova-compute[75233]:     </disk>
Dec 05 13:46:24 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:46:24 user nova-compute[75233]:       <mac address="fa:16:3e:b0:f9:be"/>
Dec 05 13:46:24 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:46:24 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:46:24 user nova-compute[75233]:       <target dev="tapfa063bc7-cc"/>
Dec 05 13:46:24 user nova-compute[75233]:     </interface>
Dec 05 13:46:24 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:46:24 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/console.log" append="off"/>
Dec 05 13:46:24 user nova-compute[75233]:     </serial>
Dec 05 13:46:24 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:46:24 user nova-compute[75233]:     <video>
Dec 05 13:46:24 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:46:24 user nova-compute[75233]:     </video>
Dec 05 13:46:24 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:46:24 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:46:24 user nova-compute[75233]:     </rng>
Dec 05 13:46:24 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:46:24 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:46:24 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:46:24 user nova-compute[75233]:     </memballoon>
Dec 05 13:46:24 user nova-compute[75233]:   </devices>
Dec 05 13:46:24 user nova-compute[75233]: </domain>
Dec 05 13:46:24 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1683810375',display_name='tempest-TestServerVolumeAttachmentScenario-server-1683810375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1683810375',id=19,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqSaVHO8f60RVcpGIEkfGhT9t+LWFG/9rjTmFbkF4pAOdZ3b5tTBnESEF5bqo6LIIwex1OJk/TCZ0fUJkUEpZOQO1YNvkpqMic5Xit5SYfe8E3ENPqn0Xrg/Kffgr1sNg==',key_name='tempest-keypair-55988495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b2ce2c635bf41cb858f09061d5491bc',ramdisk_id='',reservation_id='r-yu50bo6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1500715046',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1500715046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf813870948a4870b545b0e886df6567',uuid=84e303d2-b587-4574-bd33-d682e74289a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Converting VIF {"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG os_vif [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53c7f830-27b0-58ad-b668-63b9020313fe', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa063bc7-cc, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa063bc7-cc, col_values=(('qos', UUID('7f039b31-ed2b-4b98-b03b-a086ee64fc15')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa063bc7-cc, col_values=(('external_ids', {'iface-id': 'fa063bc7-cc2e-44b9-99b5-723c5ce240cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f9:be', 'vm-uuid': '84e303d2-b587-4574-bd33-d682e74289a9'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:24 user nova-compute[75233]: INFO os_vif [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc')
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Successfully updated port: 79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "refresh_cache-c1cdc84b-3fe7-4965-8e2e-9c202d372274" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquired lock "refresh_cache-c1cdc84b-3fe7-4965-8e2e-9c202d372274" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No VIF found with MAC fa:16:3e:b0:f9:be, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-changed-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Refreshing instance network info cache due to event network-changed-79466a7d-f58c-4226-b2b3-3db4a88c3fd2. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:46:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] Acquiring lock "refresh_cache-c1cdc84b-3fe7-4965-8e2e-9c202d372274" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d1462005-63a7-4b1e-b636-2f0daa7d5700 is timed out.
Dec 05 13:46:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully detached device vdb from instance d1462005-63a7-4b1e-b636-2f0daa7d5700 from the live domain config.
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBsYKAUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:46:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c3cd2-d61d-4ac2-b4a7-7d7d0ab66bfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:46:25 user nova-compute[75233]: No targets found.
Dec 05 13:46:25 user nova-compute[75233]: iSNS:
Dec 05 13:46:25 user nova-compute[75233]: No targets found.
Dec 05 13:46:25 user nova-compute[75233]: STATIC:
Dec 05 13:46:25 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045
Dec 05 13:46:25 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:46:25 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:46:25 user nova-compute[75233]: FIRMWARE:
Dec 05 13:46:25 user nova-compute[75233]: No targets found.
Dec 05 13:46:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:46:25 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:46:25 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4a7c63-53bc-4b91-8cda-3f1176b943eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5215e1-7fb7-496c-a2cc-d66cd9bc7ae5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)
Dec 05 13:46:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 (non-flash)
Dec 05 13:46:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582cfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c2043-b6e5-4810-aab6-45b3c2d85049]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c880209-509a-4062-85f2-7226202a029d]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f90fc8e-3992-440e-bf83-625dc0015e2a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updated VIF entry in instance network info cache for port fa063bc7-cc2e-44b9-99b5-723c5ce240cf. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updating instance_info_cache with network_info: [{"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36e12b9-a99f-4a4f-8d2d-f9dc8db5d919]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-964f5a03-4909-4268-adca-4fcdc0e976b6 req-49d9402a-12cd-4196-8fa4-dfe63d23b122 service nova] Releasing lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[253020ab-c81a-4c0b-a1dc-b52ac99e466e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Updating instance_info_cache with network_info: [{"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9931744-b40c-435b-9953-48dffa6997cb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260]
Dec 05 13:46:25 user nova-compute[75233]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045, portal: 172.16.0.220,3260] successful.
Dec 05 13:46:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Releasing lock "refresh_cache-c1cdc84b-3fe7-4965-8e2e-9c202d372274" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Instance network_info: |[{"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] Acquired lock "refresh_cache-c1cdc84b-3fe7-4965-8e2e-9c202d372274" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Refreshing network info cache for port 79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Start _get_guest_xml network_info=[{"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:46:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:46:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f98e85-381d-4a9d-8914-e46e3d6e9054]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== disconnect_volume: return (339ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-490306908',display_name='tempest-DeleteServersTestJSON-server-490306908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-490306908',id=20,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27e17ec7e000470e9c2a0d58119f25e3',ramdisk_id='',reservation_id='r-7a5hlqpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1495418042',owner_user_name='tempest-DeleteServersTestJSON-1495418042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:46:24Z,user_data=None,user_id='933c647e356948fc9c47ca719629fa1e',uuid=c1cdc84b-3fe7-4965-8e2e-9c202d372274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Converting VIF {"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.objects.instance [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lazy-loading 'pci_devices' on Instance uuid c1cdc84b-3fe7-4965-8e2e-9c202d372274 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:46:25 user nova-compute[75233]:   <uuid>c1cdc84b-3fe7-4965-8e2e-9c202d372274</uuid>
Dec 05 13:46:25 user nova-compute[75233]:   <name>instance-00000014</name>
Dec 05 13:46:25 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:46:25 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:46:25 user nova-compute[75233]:   <metadata>
Dec 05 13:46:25 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:46:25 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:46:25 user nova-compute[75233]:       <nova:name>tempest-DeleteServersTestJSON-server-490306908</nova:name>
Dec 05 13:46:25 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:46:25</nova:creationTime>
Dec 05 13:46:25 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:46:25 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:46:25 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:46:25 user nova-compute[75233]:       <nova:owner>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:user uuid="933c647e356948fc9c47ca719629fa1e">tempest-DeleteServersTestJSON-1495418042-project-member</nova:user>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:project uuid="27e17ec7e000470e9c2a0d58119f25e3">tempest-DeleteServersTestJSON-1495418042</nova:project>
Dec 05 13:46:25 user nova-compute[75233]:       </nova:owner>
Dec 05 13:46:25 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:46:25 user nova-compute[75233]:       <nova:ports>
Dec 05 13:46:25 user nova-compute[75233]:         <nova:port uuid="79466a7d-f58c-4226-b2b3-3db4a88c3fd2">
Dec 05 13:46:25 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 13:46:25 user nova-compute[75233]:         </nova:port>
Dec 05 13:46:25 user nova-compute[75233]:       </nova:ports>
Dec 05 13:46:25 user nova-compute[75233]:     </nova:instance>
Dec 05 13:46:25 user nova-compute[75233]:   </metadata>
Dec 05 13:46:25 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:46:25 user nova-compute[75233]:     <system>
Dec 05 13:46:25 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:46:25 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:46:25 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:46:25 user nova-compute[75233]:       <entry name="serial">c1cdc84b-3fe7-4965-8e2e-9c202d372274</entry>
Dec 05 13:46:25 user nova-compute[75233]:       <entry name="uuid">c1cdc84b-3fe7-4965-8e2e-9c202d372274</entry>
Dec 05 13:46:25 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:46:25 user nova-compute[75233]:     </system>
Dec 05 13:46:25 user nova-compute[75233]:   </sysinfo>
Dec 05 13:46:25 user nova-compute[75233]:   <os>
Dec 05 13:46:25 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:46:25 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:46:25 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:46:25 user nova-compute[75233]:   </os>
Dec 05 13:46:25 user nova-compute[75233]:   <features>
Dec 05 13:46:25 user nova-compute[75233]:     <acpi/>
Dec 05 13:46:25 user nova-compute[75233]:     <apic/>
Dec 05 13:46:25 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:46:25 user nova-compute[75233]:   </features>
Dec 05 13:46:25 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:46:25 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:46:25 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:46:25 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:46:25 user nova-compute[75233]:   </clock>
Dec 05 13:46:25 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:46:25 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:46:25 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:46:25 user nova-compute[75233]:   </cpu>
Dec 05 13:46:25 user nova-compute[75233]:   <devices>
Dec 05 13:46:25 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:46:25 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:46:25 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk"/>
Dec 05 13:46:25 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:46:25 user nova-compute[75233]:     </disk>
Dec 05 13:46:25 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:46:25 user nova-compute[75233]:       <mac address="fa:16:3e:72:1b:5f"/>
Dec 05 13:46:25 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:46:25 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:46:25 user nova-compute[75233]:       <target dev="tap79466a7d-f5"/>
Dec 05 13:46:25 user nova-compute[75233]:     </interface>
Dec 05 13:46:25 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:46:25 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/console.log" append="off"/>
Dec 05 13:46:25 user nova-compute[75233]:     </serial>
Dec 05 13:46:25 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:46:25 user nova-compute[75233]:     <video>
Dec 05 13:46:25 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:46:25 user nova-compute[75233]:     </video>
Dec 05 13:46:25 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:46:25 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:46:25 user nova-compute[75233]:     </rng>
Dec 05 13:46:25 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:46:25 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:46:25 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:46:25 user nova-compute[75233]:     </memballoon>
Dec 05 13:46:25 user nova-compute[75233]:   </devices>
Dec 05 13:46:25 user nova-compute[75233]: </domain>
Dec 05 13:46:25 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-490306908',display_name='tempest-DeleteServersTestJSON-server-490306908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-490306908',id=20,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27e17ec7e000470e9c2a0d58119f25e3',ramdisk_id='',reservation_id='r-7a5hlqpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1495418042',owner_user_name='tempest-DeleteServersTestJSON-1495418042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:46:24Z,user_data=None,user_id='933c647e356948fc9c47ca719629fa1e',uuid=c1cdc84b-3fe7-4965-8e2e-9c202d372274,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Converting VIF {"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG os_vif [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2aa7b810-ecb6-5b84-83d8-1b1a5d1a0356', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79466a7d-f5, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79466a7d-f5, col_values=(('qos', UUID('77f49e5e-35bb-499c-9b54-3902305c9fab')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79466a7d-f5, col_values=(('external_ids', {'iface-id': '79466a7d-f58c-4226-b2b3-3db4a88c3fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:1b:5f', 'vm-uuid': 'c1cdc84b-3fe7-4965-8e2e-9c202d372274'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:25 user nova-compute[75233]: INFO os_vif [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5')
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] No VIF found with MAC fa:16:3e:72:1b:5f, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Updated VIF entry in instance network info cache for port 79466a7d-f58c-4226-b2b3-3db4a88c3fd2. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:46:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Updating instance_info_cache with network_info: [{"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4089d770-45e1-4616-9d3a-753e0e70b49d req-661083ed-3c5d-492f-ab99-4d69aa3c84b5 service nova] Releasing lock "refresh_cache-c1cdc84b-3fe7-4965-8e2e-9c202d372274" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'flavor' on Instance uuid d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2ac0a56-9ab7-4453-8195-03399fa118d3 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.954s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.794s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:26 user nova-compute[75233]: INFO nova.compute.manager [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Terminating instance
Dec 05 13:46:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-8e1f1ece-12c5-42fb-8918-06d229e9dfda req-ce7eed73-0cb7-44ca-92aa-73c1f2c306b5 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-unplugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8e1f1ece-12c5-42fb-8918-06d229e9dfda req-ce7eed73-0cb7-44ca-92aa-73c1f2c306b5 service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8e1f1ece-12c5-42fb-8918-06d229e9dfda req-ce7eed73-0cb7-44ca-92aa-73c1f2c306b5 service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8e1f1ece-12c5-42fb-8918-06d229e9dfda req-ce7eed73-0cb7-44ca-92aa-73c1f2c306b5 service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-8e1f1ece-12c5-42fb-8918-06d229e9dfda req-ce7eed73-0cb7-44ca-92aa-73c1f2c306b5 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-unplugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-8e1f1ece-12c5-42fb-8918-06d229e9dfda req-ce7eed73-0cb7-44ca-92aa-73c1f2c306b5 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-unplugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Instance destroyed successfully.
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lazy-loading 'resources' on Instance uuid d1462005-63a7-4b1e-b636-2f0daa7d5700 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1100068851',display_name='tempest-VolumesSnapshotTestJSON-instance-1100068851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1100068851',id=16,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCbw7OJPihQt9Ijf/NVaOzKpcPqZ6GSEU7zQTS1IuAqrbtVzqs7pN5Y6xee4wr7Gg61G3r3Zmi0914utrcrW28kyyp6zbDlP/t6Jk3Cb2RVXjivsh+dzDRVIC0xLAwWng==',key_name='tempest-keypair-480069886',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:43:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc0f5f6a8ad42c989c5900f97815384',ramdisk_id='',reservation_id='r-lr97balv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1540026955',owner_user_name='tempest-VolumesSnapshotTestJSON-1540026955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e64aa1ef9e44d52a0587c6b009a1e9a',uuid=d1462005-63a7-4b1e-b636-2f0daa7d5700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converting VIF {"id": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "address": "fa:16:3e:1b:43:63", "network": {"id": "da72ebfa-a964-480b-958d-ef8a18cc2504", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1695018344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc0f5f6a8ad42c989c5900f97815384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc658684-4b", "ovs_interfaceid": "dc658684-4b4c-4829-8d3d-ed1e44aeb5be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_vif [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc658684-4b, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d42724da-22af-42f8-b41b-e96da763e334) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:27 user nova-compute[75233]: INFO os_vif [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:43:63,bridge_name='br-int',has_traffic_filtering=True,id=dc658684-4b4c-4829-8d3d-ed1e44aeb5be,network=Network(da72ebfa-a964-480b-958d-ef8a18cc2504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc658684-4b')
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:597ff61f-4508-47e6-b266-da1edfacd045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBsYKAUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:46:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3bf8a352-56fc-4d8e-9c0e-1bfd4bab965e]: Unexpected error while running command.
Dec 05 13:46:27 user nova-compute[75233]: Command: iscsiadm -m discoverydb -o show -P 1
Dec 05 13:46:27 user nova-compute[75233]: Exit code: 21
Dec 05 13:46:27 user nova-compute[75233]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Dec 05 13:46:27 user nova-compute[75233]: Stderr: '' {{(pid=86205) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Dec 05 13:46:27 user nova-compute[75233]: Traceback (most recent call last):
Dec 05 13:46:27 user nova-compute[75233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Dec 05 13:46:27 user nova-compute[75233]:     ret = func(*f_args, **f_kwargs)
Dec 05 13:46:27 user nova-compute[75233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Dec 05 13:46:27 user nova-compute[75233]:     return func(*args, **kwargs)
Dec 05 13:46:27 user nova-compute[75233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Dec 05 13:46:27 user nova-compute[75233]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Dec 05 13:46:27 user nova-compute[75233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Dec 05 13:46:27 user nova-compute[75233]:     return putils.execute(on_execute=on_execute,
Dec 05 13:46:27 user nova-compute[75233]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Dec 05 13:46:27 user nova-compute[75233]:     raise ProcessExecutionError(exit_code=_returncode,
Dec 05 13:46:27 user nova-compute[75233]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Dec 05 13:46:27 user nova-compute[75233]: Command: iscsiadm -m discoverydb -o show -P 1
Dec 05 13:46:27 user nova-compute[75233]: Exit code: 21
Dec 05 13:46:27 user nova-compute[75233]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Dec 05 13:46:27 user nova-compute[75233]: Stderr: ''
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf8a352-56fc-4d8e-9c0e-1bfd4bab965e]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Dec 05 13:46:27 user nova-compute[75233]: Command: iscsiadm -m discoverydb -o show -P 1
Dec 05 13:46:27 user nova-compute[75233]: Exit code: 21
Dec 05 13:46:27 user nova-compute[75233]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Dec 05 13:46:27 user nova-compute[75233]: Stderr: ''
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Dec 05 13:46:27 user nova-compute[75233]: ERROR os_brick.initiator.connectors.iscsi 
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75233) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] <== disconnect_volume: return (35ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:46:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Deleting instance files /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700_del
Dec 05 13:46:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Deletion of /opt/stack/data/nova/instances/d1462005-63a7-4b1e-b636-2f0daa7d5700_del complete
Dec 05 13:46:27 user nova-compute[75233]: INFO nova.compute.manager [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Took 1.56 seconds to destroy the instance on the hypervisor.
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-fc909ae6-67f8-44ea-bc28-a039f0c7566c req-9bf20c00-e63d-4ca0-acce-ac38b1ee9f5d service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fc909ae6-67f8-44ea-bc28-a039f0c7566c req-9bf20c00-e63d-4ca0-acce-ac38b1ee9f5d service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fc909ae6-67f8-44ea-bc28-a039f0c7566c req-9bf20c00-e63d-4ca0-acce-ac38b1ee9f5d service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fc909ae6-67f8-44ea-bc28-a039f0c7566c req-9bf20c00-e63d-4ca0-acce-ac38b1ee9f5d service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-fc909ae6-67f8-44ea-bc28-a039f0c7566c req-9bf20c00-e63d-4ca0-acce-ac38b1ee9f5d service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:27 user nova-compute[75233]: WARNING nova.compute.manager [req-fc909ae6-67f8-44ea-bc28-a039f0c7566c req-9bf20c00-e63d-4ca0-acce-ac38b1ee9f5d service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state building and task_state spawning.
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-f3bfde69-334f-4012-8e6d-dfe9166089d8 req-c95e1d9b-e31f-4767-8120-26d1ff88ccbb service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f3bfde69-334f-4012-8e6d-dfe9166089d8 req-c95e1d9b-e31f-4767-8120-26d1ff88ccbb service nova] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f3bfde69-334f-4012-8e6d-dfe9166089d8 req-c95e1d9b-e31f-4767-8120-26d1ff88ccbb service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f3bfde69-334f-4012-8e6d-dfe9166089d8 req-c95e1d9b-e31f-4767-8120-26d1ff88ccbb service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-f3bfde69-334f-4012-8e6d-dfe9166089d8 req-c95e1d9b-e31f-4767-8120-26d1ff88ccbb service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] No waiting events found dispatching network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:28 user nova-compute[75233]: WARNING nova.compute.manager [req-f3bfde69-334f-4012-8e6d-dfe9166089d8 req-c95e1d9b-e31f-4767-8120-26d1ff88ccbb service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received unexpected event network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 for instance with vm_state building and task_state spawning.
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:28 user nova-compute[75233]: WARNING nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received unexpected event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with vm_state active and task_state deleting.
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:28 user nova-compute[75233]: WARNING nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received unexpected event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with vm_state active and task_state deleting.
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:28 user nova-compute[75233]: WARNING nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received unexpected event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with vm_state active and task_state deleting.
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-unplugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-unplugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-unplugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Acquiring lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] No waiting events found dispatching network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:28 user nova-compute[75233]: WARNING nova.compute.manager [req-77d8e71f-4372-4d45-8ce0-e7d5e5300f97 req-9d2e8b74-dd8e-4c24-be6c-f0d5724c9aef service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received unexpected event network-vif-plugged-dc658684-4b4c-4829-8d3d-ed1e44aeb5be for instance with vm_state active and task_state deleting.
Dec 05 13:46:29 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:29 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Took 1.10 seconds to deallocate network for instance.
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: WARNING nova.volume.cinder [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Attachment 05eac400-851f-4548-b067-d80dbc8bd403 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 05eac400-851f-4548-b067-d80dbc8bd403. (HTTP 404) (Request-ID: req-a2308054-d633-4b53-86f4-33bd9adb2fd2)
Dec 05 13:46:29 user nova-compute[75233]: INFO nova.compute.manager [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Took 0.02 seconds to detach 1 volumes for instance.
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:29 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Deleted allocations for instance d1462005-63a7-4b1e-b636-2f0daa7d5700
Dec 05 13:46:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5cefa740-1ef0-4f09-af11-54c718cb0947 tempest-VolumesSnapshotTestJSON-1540026955 tempest-VolumesSnapshotTestJSON-1540026955-project-member] Lock "d1462005-63a7-4b1e-b636-2f0daa7d5700" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.349s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:30 user nova-compute[75233]: WARNING nova.compute.manager [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state building and task_state spawning.
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-b4fb0703-805a-455c-9d18-a57e85165070 req-627fd003-6023-4817-82ce-9d7b325235b8 service nova] [instance: d1462005-63a7-4b1e-b636-2f0daa7d5700] Received event network-vif-deleted-dc658684-4b4c-4829-8d3d-ed1e44aeb5be {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-e70558dc-314f-41a0-868e-2d137d97e429 req-b208088c-20e6-4dc4-a0eb-4d83341d3436 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e70558dc-314f-41a0-868e-2d137d97e429 req-b208088c-20e6-4dc4-a0eb-4d83341d3436 service nova] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e70558dc-314f-41a0-868e-2d137d97e429 req-b208088c-20e6-4dc4-a0eb-4d83341d3436 service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e70558dc-314f-41a0-868e-2d137d97e429 req-b208088c-20e6-4dc4-a0eb-4d83341d3436 service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-e70558dc-314f-41a0-868e-2d137d97e429 req-b208088c-20e6-4dc4-a0eb-4d83341d3436 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] No waiting events found dispatching network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:30 user nova-compute[75233]: WARNING nova.compute.manager [req-e70558dc-314f-41a0-868e-2d137d97e429 req-b208088c-20e6-4dc4-a0eb-4d83341d3436 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received unexpected event network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 for instance with vm_state building and task_state spawning.
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:46:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Instance spawned successfully.
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:46:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Instance spawned successfully.
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:46:31 user nova-compute[75233]: INFO nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Took 8.47 seconds to spawn the instance on the hypervisor.
Dec 05 13:46:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:46:31 user nova-compute[75233]: INFO nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Took 7.33 seconds to spawn the instance on the hypervisor.
Dec 05 13:46:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:46:31 user nova-compute[75233]: INFO nova.compute.manager [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Took 9.27 seconds to build instance.
Dec 05 13:46:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b4979319-c96c-4d0d-88d3-c38afe1876d2 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.386s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:31 user nova-compute[75233]: INFO nova.compute.manager [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Took 8.36 seconds to build instance.
Dec 05 13:46:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eba7d2b2-60d8-4a5a-8060-83a5bb638610 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.535s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:46:37 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:46:37 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:46:37 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0591e7e-3bac-4850-92ec-0aa5561935a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:46:37 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43ccd2a-619e-4b71-92dd-17c34366dda2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c] added
Dec 05 13:46:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa81d12b-4f0b-4086-a2a4-ba056909100a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad82d5e-c667-4a27-833c-5bc2d0e73072]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyOjtDNb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyOjtDNb" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d826b5-7efd-467e-a570-674ab4c0857c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyOjtDNb'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0106e16e-1118-461d-80e1-ef862d59c860]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f39bf4-5a12-4f46-989b-47887efd51bf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 13:46:37 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 13:46:37 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:46:37 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 13:46:37 user nova-compute[75233]: 
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a94afc-6b4f-42e4-b9cb-95ccfd4f3df1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]
Dec 05 13:46:37 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.
Dec 05 13:46:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087369e-dcdc-4d2c-b790-fc9a89bbe72b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7089f5-afa2-4ba1-a3c1-a116a4707487]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:46:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:46:37 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c877c51c-3335-4d23-96ed-01e448987653]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:46:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23661353462316431', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661353462316431', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:46:38 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:46:38 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:46:38 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:46:38 user nova-compute[75233]:   <serial>1c48c470-ff2e-4d63-9fcf-9199c5a5741c</serial>
Dec 05 13:46:38 user nova-compute[75233]: </disk>
Dec 05 13:46:38 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:46:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:46:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:46:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No VIF found with MAC fa:16:3e:d5:3a:57, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:46:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-928afb95-5bca-4b19-a0e2-c964bf1d1f19 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.755s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75233) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-f923ab85-556d-4581-b209-4c95ba49826a req-33702606-1e49-4d63-90a4-779e9785df7d service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f923ab85-556d-4581-b209-4c95ba49826a req-33702606-1e49-4d63-90a4-779e9785df7d service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f923ab85-556d-4581-b209-4c95ba49826a req-33702606-1e49-4d63-90a4-779e9785df7d service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f923ab85-556d-4581-b209-4c95ba49826a req-33702606-1e49-4d63-90a4-779e9785df7d service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-f923ab85-556d-4581-b209-4c95ba49826a req-33702606-1e49-4d63-90a4-779e9785df7d service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:40 user nova-compute[75233]: WARNING nova.compute.manager [req-f923ab85-556d-4581-b209-4c95ba49826a req-33702606-1e49-4d63-90a4-779e9785df7d service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state active and task_state powering-off.
Dec 05 13:46:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance destroyed successfully.
Dec 05 13:46:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:46:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-789a4120-966f-4761-83eb-ecfba561b044 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.938s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-81622fd1-381d-4e1a-9874-22d702c0e38b req-b9cbf137-51b7-4e57-a93e-c07f42eef14e service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-81622fd1-381d-4e1a-9874-22d702c0e38b req-b9cbf137-51b7-4e57-a93e-c07f42eef14e service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-81622fd1-381d-4e1a-9874-22d702c0e38b req-b9cbf137-51b7-4e57-a93e-c07f42eef14e service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-81622fd1-381d-4e1a-9874-22d702c0e38b req-b9cbf137-51b7-4e57-a93e-c07f42eef14e service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-81622fd1-381d-4e1a-9874-22d702c0e38b req-b9cbf137-51b7-4e57-a93e-c07f42eef14e service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:46:42 user nova-compute[75233]: WARNING nova.compute.manager [req-81622fd1-381d-4e1a-9874-22d702c0e38b req-b9cbf137-51b7-4e57-a93e-c07f42eef14e service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state stopped and task_state None.
Dec 05 13:46:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:46:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:46:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:46:47 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=25.28866195678711GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 84e303d2-b587-4574-bd33-d682e74289a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance c1cdc84b-3fe7-4965-8e2e-9c202d372274 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:46:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:46:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:53 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:46:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:46:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:46:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:46:53 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:46:54 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:46:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:46:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:46:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:46:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'flavor' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:03 user nova-compute[75233]: INFO nova.compute.manager [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Attaching volume c98a70fc-f8bf-435c-804e-54bafb5cf870 to /dev/vdb
Dec 05 13:47:03 user nova-compute[75233]: DEBUG os_brick.utils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d1d41a-6b1c-4c78-90d0-76f91cb6e6b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99d355-d621-4e0a-9c41-1638b5796276]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ba417-d577-4220-9bf2-338da665c63c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c0dd7-68a9-434f-aaa7-6c60fc187047]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:47:03 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:47:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[807fedd6-e5bc-4d82-ad4c-18002cd55a9c]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG os_brick.utils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:47:03 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating existing volume attachment record: 12e22fe5-6b86-4b92-9061-a357a0e055b2 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:47:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:47:12 user nova-compute[75233]: INFO nova.compute.claims [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Claim successful on node user
Dec 05 13:47:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:12 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:47:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.policy [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7ddf7a828a547e9b606ed9e8e8727eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b7c3d1e9a7462b8c4833174777873e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:47:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Creating image(s)
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk 1073741824" returned: 0 in 0.060s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Successfully created port: 1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:47:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Cannot resize image /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Ensure instance console log exists: /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Successfully updated port: 1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing instance network info cache due to event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance network_info: |[{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Start _get_guest_xml network_info=[{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:47:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:47:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-680434618',display_name='tempest-ServerRescueNegativeTestJSON-server-680434618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-680434618',id=21,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpccRe6hIADiJ7Et68v/LZB0pXu1DVkRqKIgjrV5HlRSbTkySUEcjRhIMF4tGXTsUKj9ERGLozGck76J7eTzgkALmXLWlmj4hy7CLqM5BYmPrSkCZzMJpLz8466cLaacg==',key_name='tempest-keypair-1531648438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1gvknz6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=b4b42e4d-f5e2-48ec-842a-536a1f250585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'pci_devices' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:47:15 user nova-compute[75233]:   <uuid>b4b42e4d-f5e2-48ec-842a-536a1f250585</uuid>
Dec 05 13:47:15 user nova-compute[75233]:   <name>instance-00000015</name>
Dec 05 13:47:15 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:47:15 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:47:15 user nova-compute[75233]:   <metadata>
Dec 05 13:47:15 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:47:15 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:47:15 user nova-compute[75233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-680434618</nova:name>
Dec 05 13:47:15 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:47:14</nova:creationTime>
Dec 05 13:47:15 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:47:15 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:47:15 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:47:15 user nova-compute[75233]:       <nova:owner>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:user uuid="e7ddf7a828a547e9b606ed9e8e8727eb">tempest-ServerRescueNegativeTestJSON-2142653953-project-member</nova:user>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:project uuid="16b7c3d1e9a7462b8c4833174777873e">tempest-ServerRescueNegativeTestJSON-2142653953</nova:project>
Dec 05 13:47:15 user nova-compute[75233]:       </nova:owner>
Dec 05 13:47:15 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:47:15 user nova-compute[75233]:       <nova:ports>
Dec 05 13:47:15 user nova-compute[75233]:         <nova:port uuid="1405dadf-e129-4a04-b5e2-ef49395ebcdd">
Dec 05 13:47:15 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:47:15 user nova-compute[75233]:         </nova:port>
Dec 05 13:47:15 user nova-compute[75233]:       </nova:ports>
Dec 05 13:47:15 user nova-compute[75233]:     </nova:instance>
Dec 05 13:47:15 user nova-compute[75233]:   </metadata>
Dec 05 13:47:15 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:47:15 user nova-compute[75233]:     <system>
Dec 05 13:47:15 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:47:15 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:47:15 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:47:15 user nova-compute[75233]:       <entry name="serial">b4b42e4d-f5e2-48ec-842a-536a1f250585</entry>
Dec 05 13:47:15 user nova-compute[75233]:       <entry name="uuid">b4b42e4d-f5e2-48ec-842a-536a1f250585</entry>
Dec 05 13:47:15 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:47:15 user nova-compute[75233]:     </system>
Dec 05 13:47:15 user nova-compute[75233]:   </sysinfo>
Dec 05 13:47:15 user nova-compute[75233]:   <os>
Dec 05 13:47:15 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:47:15 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:47:15 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:47:15 user nova-compute[75233]:   </os>
Dec 05 13:47:15 user nova-compute[75233]:   <features>
Dec 05 13:47:15 user nova-compute[75233]:     <acpi/>
Dec 05 13:47:15 user nova-compute[75233]:     <apic/>
Dec 05 13:47:15 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:47:15 user nova-compute[75233]:   </features>
Dec 05 13:47:15 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:47:15 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:47:15 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:47:15 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:47:15 user nova-compute[75233]:   </clock>
Dec 05 13:47:15 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:47:15 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:47:15 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:47:15 user nova-compute[75233]:   </cpu>
Dec 05 13:47:15 user nova-compute[75233]:   <devices>
Dec 05 13:47:15 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:47:15 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:47:15 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk"/>
Dec 05 13:47:15 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:47:15 user nova-compute[75233]:     </disk>
Dec 05 13:47:15 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:47:15 user nova-compute[75233]:       <mac address="fa:16:3e:9f:2a:f2"/>
Dec 05 13:47:15 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:47:15 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:47:15 user nova-compute[75233]:       <target dev="tap1405dadf-e1"/>
Dec 05 13:47:15 user nova-compute[75233]:     </interface>
Dec 05 13:47:15 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:47:15 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/console.log" append="off"/>
Dec 05 13:47:15 user nova-compute[75233]:     </serial>
Dec 05 13:47:15 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:47:15 user nova-compute[75233]:     <video>
Dec 05 13:47:15 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:47:15 user nova-compute[75233]:     </video>
Dec 05 13:47:15 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:47:15 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:47:15 user nova-compute[75233]:     </rng>
Dec 05 13:47:15 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:47:15 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:47:15 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:47:15 user nova-compute[75233]:     </memballoon>
Dec 05 13:47:15 user nova-compute[75233]:   </devices>
Dec 05 13:47:15 user nova-compute[75233]: </domain>
Dec 05 13:47:15 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-680434618',display_name='tempest-ServerRescueNegativeTestJSON-server-680434618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-680434618',id=21,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpccRe6hIADiJ7Et68v/LZB0pXu1DVkRqKIgjrV5HlRSbTkySUEcjRhIMF4tGXTsUKj9ERGLozGck76J7eTzgkALmXLWlmj4hy7CLqM5BYmPrSkCZzMJpLz8466cLaacg==',key_name='tempest-keypair-1531648438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1gvknz6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=b4b42e4d-f5e2-48ec-842a-536a1f250585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG os_vif [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66f5c1c8-bec9-5ab3-9bbe-2c85483debb3', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1405dadf-e1, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1405dadf-e1, col_values=(('qos', UUID('5fceefd9-8c62-465f-80fc-aaa3b032a020')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1405dadf-e1, col_values=(('external_ids', {'iface-id': '1405dadf-e129-4a04-b5e2-ef49395ebcdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:2a:f2', 'vm-uuid': 'b4b42e4d-f5e2-48ec-842a-536a1f250585'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:15 user nova-compute[75233]: INFO os_vif [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1')
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:9f:2a:f2, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updated VIF entry in instance network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-05687632-7098-417e-b238-6f0fe6011a7a req-eba5bcf3-92ef-45be-a25a-95a689e55a51 service nova] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f665baa-01b9-41c6-b8e2-1daef0a2811b req-2ef63dfb-4df0-40a1-bd83-3ee4f6dd0dff service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f665baa-01b9-41c6-b8e2-1daef0a2811b req-2ef63dfb-4df0-40a1-bd83-3ee4f6dd0dff service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f665baa-01b9-41c6-b8e2-1daef0a2811b req-2ef63dfb-4df0-40a1-bd83-3ee4f6dd0dff service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f665baa-01b9-41c6-b8e2-1daef0a2811b req-2ef63dfb-4df0-40a1-bd83-3ee4f6dd0dff service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f665baa-01b9-41c6-b8e2-1daef0a2811b req-2ef63dfb-4df0-40a1-bd83-3ee4f6dd0dff service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:16 user nova-compute[75233]: WARNING nova.compute.manager [req-6f665baa-01b9-41c6-b8e2-1daef0a2811b req-2ef63dfb-4df0-40a1-bd83-3ee4f6dd0dff service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state building and task_state spawning.
Dec 05 13:47:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:47:18 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:47:18 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:47:18 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[00318387-8538-460f-898b-04e389b5c18f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:47:18 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caaa089-292a-417e-9570-0fa07d842a91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870] added
Dec 05 13:47:18 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faea355-b84b-4544-a67b-bbdcdb9e945d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d181cce0-a966-4105-af71-d129ed6ec26d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBVwOcqW {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBVwOcqW" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbcda01-ad84-4161-82c8-3fb8f940eb84]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBVwOcqW'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09dd6ef-7344-4a85-a93d-7b1b913b1bd2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2135f600-b0d8-44c8-b7d0-a6ee5585b15f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:18 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:18 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c24a4-abee-4d24-95d9-1b1bca6a4add]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]
Dec 05 13:47:18 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.
Dec 05 13:47:18 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[036fb0d1-8e9a-4646-a068-ea22c47cc168]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffcc0ca-5ad6-4556-8bf2-d6b033c6b24a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:18 user nova-compute[75233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:47:18 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:18 user nova-compute[75233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:47:18 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7919986c-8085-4997-93e9-b724fbd6be2f]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:47:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance spawned successfully.
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:18 user nova-compute[75233]: INFO nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Took 5.60 seconds to spawn the instance on the hypervisor.
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-dca80f5d-bf15-48e5-9aaa-feae3c63ed90 req-31c8f2f5-c5ab-46d9-9c65-45773a0d868a service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dca80f5d-bf15-48e5-9aaa-feae3c63ed90 req-31c8f2f5-c5ab-46d9-9c65-45773a0d868a service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dca80f5d-bf15-48e5-9aaa-feae3c63ed90 req-31c8f2f5-c5ab-46d9-9c65-45773a0d868a service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dca80f5d-bf15-48e5-9aaa-feae3c63ed90 req-31c8f2f5-c5ab-46d9-9c65-45773a0d868a service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-dca80f5d-bf15-48e5-9aaa-feae3c63ed90 req-31c8f2f5-c5ab-46d9-9c65-45773a0d868a service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:18 user nova-compute[75233]: WARNING nova.compute.manager [req-dca80f5d-bf15-48e5-9aaa-feae3c63ed90 req-31c8f2f5-c5ab-46d9-9c65-45773a0d868a service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state building and task_state spawning.
Dec 05 13:47:18 user nova-compute[75233]: INFO nova.compute.manager [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Took 6.36 seconds to build instance.
Dec 05 13:47:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8a06d71e-333b-4907-9078-860a58a31271 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.468s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:47:19 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26539343962653831', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:47:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539343962653831', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:47:19 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'flavor' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:47:19 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:47:19 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:47:19 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:47:19 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:47:19 user nova-compute[75233]:   <serial>c98a70fc-f8bf-435c-804e-54bafb5cf870</serial>
Dec 05 13:47:19 user nova-compute[75233]: </disk>
Dec 05 13:47:19 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:47:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:47:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:47:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No VIF found with MAC fa:16:3e:84:db:58, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:47:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95aef7ab-c102-42fe-95e7-7e39b943ec8b tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.010s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Stashing vm_state: active {{(pid=75233) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 05 13:47:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:47:22 user nova-compute[75233]: INFO nova.compute.claims [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Claim successful on node user
Dec 05 13:47:22 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating resource usage from migration 64f171e0-022e-4e32-b34e-968cb42bd031
Dec 05 13:47:23 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.466s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:23 user nova-compute[75233]: INFO nova.compute.manager [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Migrating
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:23 user nova-compute[75233]: INFO nova.compute.rpcapi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Starting migrate_disk_and_power_off {{(pid=75233) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:47:24 user nova-compute[75233]: INFO nova.compute.claims [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Claim successful on node user
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance destroyed successfully.
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG os_vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217ff3c3-5e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed52bdba-092c-41f0-95d8-4c99ff84ecf3) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:24 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:47:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:25 user nova-compute[75233]: INFO os_vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e')
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:47:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b823085-5911-40bb-a582-c7652eb12ae6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:47:25 user nova-compute[75233]: No targets found.
Dec 05 13:47:25 user nova-compute[75233]: iSNS:
Dec 05 13:47:25 user nova-compute[75233]: No targets found.
Dec 05 13:47:25 user nova-compute[75233]: STATIC:
Dec 05 13:47:25 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:47:25 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:47:25 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:47:25 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:47:25 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:47:25 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:47:25 user nova-compute[75233]: FIRMWARE:
Dec 05 13:47:25 user nova-compute[75233]: No targets found.
Dec 05 13:47:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:47:25 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:47:25 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edb22ad-2b99-471d-a32a-d90293c03d2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.policy [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebeefb2fa465406b911b62137057223a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a22149826499ba7d03f47ce7375cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d3669-16c4-40f7-b6a0-4b53c6fdae71]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:25 user nova-compute[75233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:47:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:25 user nova-compute[75233]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:47:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586ab910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5709bd8e-8aab-4262-b807-fb919e8c3178]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d186579-28dc-4470-811d-809239d9384a]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:47:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Creating image(s)
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a9648-694c-4121-872e-4e5ebb740eb8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b9df03-2dda-4b1a-a1fd-d35c7673707d]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f826db00-981e-4dca-aa3a-528a79d9d63b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b33ff-a6d8-44fb-a4b2-7e95f6214867]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]
Dec 05 13:47:25 user nova-compute[75233]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.
Dec 05 13:47:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3cc6e-1116-436f-bbb0-c88e22192e9e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== disconnect_volume: return (326ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.211s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk 1073741824" returned: 0 in 0.047s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2_resize/disk /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Successfully created port: 6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Cannot resize image /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Ensure instance console log exists: /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "cp -r /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2_resize/disk /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk" returned: 0 in 0.463s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2_resize/disk.info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk.info {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "cp -r /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2_resize/disk.info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk.info" returned: 0 in 0.045s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-7a555422-6d06-4aae-8a8a-a8b90dfaf8df req-6ae97637-f5c3-4bb0-8b0d-c7f3371efbb8 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7a555422-6d06-4aae-8a8a-a8b90dfaf8df req-6ae97637-f5c3-4bb0-8b0d-c7f3371efbb8 service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7a555422-6d06-4aae-8a8a-a8b90dfaf8df req-6ae97637-f5c3-4bb0-8b0d-c7f3371efbb8 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7a555422-6d06-4aae-8a8a-a8b90dfaf8df req-6ae97637-f5c3-4bb0-8b0d-c7f3371efbb8 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-7a555422-6d06-4aae-8a8a-a8b90dfaf8df req-6ae97637-f5c3-4bb0-8b0d-c7f3371efbb8 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:26 user nova-compute[75233]: WARNING nova.compute.manager [req-7a555422-6d06-4aae-8a8a-a8b90dfaf8df req-6ae97637-f5c3-4bb0-8b0d-c7f3371efbb8 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state active and task_state resize_migrating.
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Successfully updated port: 6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquired lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Port 217ff3c3-5eed-435e-b7b1-ec6872e83d24 binding to destination host user is already ACTIVE {{(pid=75233) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updating instance_info_cache with network_info: [{"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Releasing lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Instance network_info: |[{"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Start _get_guest_xml network_info=[{"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:47:27 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:27 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1745423441',display_name='tempest-AttachVolumeNegativeTest-server-1745423441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1745423441',id=22,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVyKJGS316z0C76qky3S9HV3ErW3BnVl5Vx46xepI5YB7fGPHQ85xhORI64DAJpGRyzEDR3uvwcL0w1rL6AsexM0h8uG8CYqU/UEgtSkSQ4ZrtORcnyxUNnTGdKqhmb9w==',key_name='tempest-keypair-1468679495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-kgkq41o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=4f0cc131-8133-40a7-b331-6c87051b7646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f0cc131-8133-40a7-b331-6c87051b7646 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:47:27 user nova-compute[75233]:   <uuid>4f0cc131-8133-40a7-b331-6c87051b7646</uuid>
Dec 05 13:47:27 user nova-compute[75233]:   <name>instance-00000016</name>
Dec 05 13:47:27 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:47:27 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:47:27 user nova-compute[75233]:   <metadata>
Dec 05 13:47:27 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:47:27 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:47:27 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1745423441</nova:name>
Dec 05 13:47:27 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:47:27</nova:creationTime>
Dec 05 13:47:27 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:47:27 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:47:27 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:47:27 user nova-compute[75233]:       <nova:owner>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:user uuid="ebeefb2fa465406b911b62137057223a">tempest-AttachVolumeNegativeTest-525245035-project-member</nova:user>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:project uuid="f73a22149826499ba7d03f47ce7375cd">tempest-AttachVolumeNegativeTest-525245035</nova:project>
Dec 05 13:47:27 user nova-compute[75233]:       </nova:owner>
Dec 05 13:47:27 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:47:27 user nova-compute[75233]:       <nova:ports>
Dec 05 13:47:27 user nova-compute[75233]:         <nova:port uuid="6009ab44-d20d-46bc-9847-842362dc8fe2">
Dec 05 13:47:27 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 13:47:27 user nova-compute[75233]:         </nova:port>
Dec 05 13:47:27 user nova-compute[75233]:       </nova:ports>
Dec 05 13:47:27 user nova-compute[75233]:     </nova:instance>
Dec 05 13:47:27 user nova-compute[75233]:   </metadata>
Dec 05 13:47:27 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:47:27 user nova-compute[75233]:     <system>
Dec 05 13:47:27 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:47:27 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:47:27 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:47:27 user nova-compute[75233]:       <entry name="serial">4f0cc131-8133-40a7-b331-6c87051b7646</entry>
Dec 05 13:47:27 user nova-compute[75233]:       <entry name="uuid">4f0cc131-8133-40a7-b331-6c87051b7646</entry>
Dec 05 13:47:27 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:47:27 user nova-compute[75233]:     </system>
Dec 05 13:47:27 user nova-compute[75233]:   </sysinfo>
Dec 05 13:47:27 user nova-compute[75233]:   <os>
Dec 05 13:47:27 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:47:27 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:47:27 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:47:27 user nova-compute[75233]:   </os>
Dec 05 13:47:27 user nova-compute[75233]:   <features>
Dec 05 13:47:27 user nova-compute[75233]:     <acpi/>
Dec 05 13:47:27 user nova-compute[75233]:     <apic/>
Dec 05 13:47:27 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:47:27 user nova-compute[75233]:   </features>
Dec 05 13:47:27 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:47:27 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:47:27 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:47:27 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:47:27 user nova-compute[75233]:   </clock>
Dec 05 13:47:27 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:47:27 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:47:27 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:47:27 user nova-compute[75233]:   </cpu>
Dec 05 13:47:27 user nova-compute[75233]:   <devices>
Dec 05 13:47:27 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:47:27 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:47:27 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk"/>
Dec 05 13:47:27 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:47:27 user nova-compute[75233]:     </disk>
Dec 05 13:47:27 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:47:27 user nova-compute[75233]:       <mac address="fa:16:3e:e9:f0:34"/>
Dec 05 13:47:27 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:47:27 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:47:27 user nova-compute[75233]:       <target dev="tap6009ab44-d2"/>
Dec 05 13:47:27 user nova-compute[75233]:     </interface>
Dec 05 13:47:27 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:47:27 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/console.log" append="off"/>
Dec 05 13:47:27 user nova-compute[75233]:     </serial>
Dec 05 13:47:27 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:47:27 user nova-compute[75233]:     <video>
Dec 05 13:47:27 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:47:27 user nova-compute[75233]:     </video>
Dec 05 13:47:27 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:47:27 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:47:27 user nova-compute[75233]:     </rng>
Dec 05 13:47:27 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:47:27 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:47:27 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:47:27 user nova-compute[75233]:     </memballoon>
Dec 05 13:47:27 user nova-compute[75233]:   </devices>
Dec 05 13:47:27 user nova-compute[75233]: </domain>
Dec 05 13:47:27 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1745423441',display_name='tempest-AttachVolumeNegativeTest-server-1745423441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1745423441',id=22,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVyKJGS316z0C76qky3S9HV3ErW3BnVl5Vx46xepI5YB7fGPHQ85xhORI64DAJpGRyzEDR3uvwcL0w1rL6AsexM0h8uG8CYqU/UEgtSkSQ4ZrtORcnyxUNnTGdKqhmb9w==',key_name='tempest-keypair-1468679495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-kgkq41o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=4f0cc131-8133-40a7-b331-6c87051b7646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG os_vif [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f567f039-942d-5271-8575-8bfb1614ca40', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6009ab44-d2, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6009ab44-d2, col_values=(('qos', UUID('bb558a18-f257-4f21-92ef-ee89d131edb2')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6009ab44-d2, col_values=(('external_ids', {'iface-id': '6009ab44-d20d-46bc-9847-842362dc8fe2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:f0:34', 'vm-uuid': '4f0cc131-8133-40a7-b331-6c87051b7646'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:27 user nova-compute[75233]: INFO os_vif [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2')
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:e9:f0:34, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG nova.network.neutron [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG os_brick.utils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c9f2c-74bf-4510-b5c1-b5c24a7d549a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d9561-75e2-4175-84a9-6f8f8cfc6f88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adfec6d-f1dd-4ea8-ad3f-ae1db9a15ea0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f42900-930e-40b1-a42b-e26e3db200f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:47:28 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:47:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[04665b35-13b4-4949-b932-88c8da9ec9ce]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:47:28 user nova-compute[75233]: DEBUG os_brick.utils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:29 user nova-compute[75233]: WARNING nova.compute.manager [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state active and task_state resize_finish.
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-changed-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Refreshing instance network info cache due to event network-changed-6009ab44-d20d-46bc-9847-842362dc8fe2. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] Acquiring lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] Acquired lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.network.neutron [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Refreshing network info cache for port 6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0cd2fa1-87cc-47c5-8bf5-695cf587ee40 req-daf978aa-7cd0-4b60-8701-3ed18bf2ebca service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0cd2fa1-87cc-47c5-8bf5-695cf587ee40 req-daf978aa-7cd0-4b60-8701-3ed18bf2ebca service nova] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0cd2fa1-87cc-47c5-8bf5-695cf587ee40 req-daf978aa-7cd0-4b60-8701-3ed18bf2ebca service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f0cd2fa1-87cc-47c5-8bf5-695cf587ee40 req-daf978aa-7cd0-4b60-8701-3ed18bf2ebca service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-f0cd2fa1-87cc-47c5-8bf5-695cf587ee40 req-daf978aa-7cd0-4b60-8701-3ed18bf2ebca service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] No waiting events found dispatching network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:29 user nova-compute[75233]: WARNING nova.compute.manager [req-f0cd2fa1-87cc-47c5-8bf5-695cf587ee40 req-daf978aa-7cd0-4b60-8701-3ed18bf2ebca service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received unexpected event network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 for instance with vm_state building and task_state spawning.
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.network.neutron [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updated VIF entry in instance network info cache for port 6009ab44-d20d-46bc-9847-842362dc8fe2. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG nova.network.neutron [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updating instance_info_cache with network_info: [{"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1d5b4c2-ac30-44c3-8399-df7d746fe222 req-a87561cf-a412-4ed0-b321-d1d94468cfe3 service nova] Releasing lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:47:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Instance spawned successfully.
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:47:31 user nova-compute[75233]: INFO nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Took 6.59 seconds to spawn the instance on the hypervisor.
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:47:31 user nova-compute[75233]: INFO nova.compute.manager [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Took 7.56 seconds to build instance.
Dec 05 13:47:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6b5ea1b6-bf2d-4dd1-a8ef-676a660cd54e tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.680s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-17735f83-60c6-4bbd-bf36-4ee41e90d935 req-6e14081d-e837-45fe-9331-a01894b13ce0 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-17735f83-60c6-4bbd-bf36-4ee41e90d935 req-6e14081d-e837-45fe-9331-a01894b13ce0 service nova] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-17735f83-60c6-4bbd-bf36-4ee41e90d935 req-6e14081d-e837-45fe-9331-a01894b13ce0 service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-17735f83-60c6-4bbd-bf36-4ee41e90d935 req-6e14081d-e837-45fe-9331-a01894b13ce0 service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-17735f83-60c6-4bbd-bf36-4ee41e90d935 req-6e14081d-e837-45fe-9331-a01894b13ce0 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] No waiting events found dispatching network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:31 user nova-compute[75233]: WARNING nova.compute.manager [req-17735f83-60c6-4bbd-bf36-4ee41e90d935 req-6e14081d-e837-45fe-9331-a01894b13ce0 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received unexpected event network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 for instance with vm_state active and task_state None.
Dec 05 13:47:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Starting finish_migration {{(pid=75233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:47:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Creating image(s)
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk. size=21474836480 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk 21474836480 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk 21474836480" returned: 0 in 0.057s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Ensure instance console log exists: /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start _get_guest_xml network_info=[{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2', 'attached_at': '2023-12-05T13:47:38.000000', 'detached_at': '', 'volume_id': 'c98a70fc-f8bf-435c-804e-54bafb5cf870', 'serial': 'c98a70fc-f8bf-435c-804e-54bafb5cf870'}, 'delete_on_termination': False, 'attachment_id': '3d886b62-5e29-4081-a1c1-3c0cac24e589', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:47:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:39 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:47:39 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:47:39 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:47:39 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b448f658-4760-4557-a3aa-f6a7f185e214]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:47:39 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e76d4a-eb70-48ce-8ec4-46b351287ba0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870] added
Dec 05 13:47:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84866fce-6806-4bed-819d-bbf96e104ad2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e86ec-06fb-4b0d-a3f3-5349f1263e78]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBVwOcqW {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBVwOcqW" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb11e6c7-ce92-4f33-9651-4558c408055e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBVwOcqW'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f96cfc2-26e7-479c-b722-cee7391a9812]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8cee07-a56a-4bef-a40e-3188566e5b72]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f8c180-9ccb-4599-952d-9d756d965a32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]
Dec 05 13:47:39 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.
Dec 05 13:47:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eab5aa-bfbb-49f1-bdf8-1ee830bcf3e3]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dbe00e-33c9-4334-a4f0-821c6904e1e6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:39 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:47:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:47:39 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:47:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3179efe-ed47-4745-bb22-3628f1578e5a]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:47:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26539343962653831', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539343962653831', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:47:40 user nova-compute[75233]:   <uuid>ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</uuid>
Dec 05 13:47:40 user nova-compute[75233]:   <name>instance-0000000f</name>
Dec 05 13:47:40 user nova-compute[75233]:   <memory>2097152</memory>
Dec 05 13:47:40 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:47:40 user nova-compute[75233]:   <metadata>
Dec 05 13:47:40 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:47:40 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:47:40 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherB-server-1529541965</nova:name>
Dec 05 13:47:40 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:47:39</nova:creationTime>
Dec 05 13:47:40 user nova-compute[75233]:       <nova:flavor name="m1.small">
Dec 05 13:47:40 user nova-compute[75233]:         <nova:memory>2048</nova:memory>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:disk>20</nova:disk>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:47:40 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:47:40 user nova-compute[75233]:       <nova:owner>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:user uuid="f607b8d442c740fe865f6b96b6dcdcbd">tempest-ServerActionsTestOtherB-963894040-project-member</nova:user>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:project uuid="434c6a79034f4bb79f70faf8c468504e">tempest-ServerActionsTestOtherB-963894040</nova:project>
Dec 05 13:47:40 user nova-compute[75233]:       </nova:owner>
Dec 05 13:47:40 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:47:40 user nova-compute[75233]:       <nova:ports>
Dec 05 13:47:40 user nova-compute[75233]:         <nova:port uuid="217ff3c3-5eed-435e-b7b1-ec6872e83d24">
Dec 05 13:47:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:47:40 user nova-compute[75233]:         </nova:port>
Dec 05 13:47:40 user nova-compute[75233]:       </nova:ports>
Dec 05 13:47:40 user nova-compute[75233]:     </nova:instance>
Dec 05 13:47:40 user nova-compute[75233]:   </metadata>
Dec 05 13:47:40 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:47:40 user nova-compute[75233]:     <system>
Dec 05 13:47:40 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:47:40 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:47:40 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:47:40 user nova-compute[75233]:       <entry name="serial">ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</entry>
Dec 05 13:47:40 user nova-compute[75233]:       <entry name="uuid">ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</entry>
Dec 05 13:47:40 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:47:40 user nova-compute[75233]:     </system>
Dec 05 13:47:40 user nova-compute[75233]:   </sysinfo>
Dec 05 13:47:40 user nova-compute[75233]:   <os>
Dec 05 13:47:40 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:47:40 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:47:40 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:47:40 user nova-compute[75233]:   </os>
Dec 05 13:47:40 user nova-compute[75233]:   <features>
Dec 05 13:47:40 user nova-compute[75233]:     <acpi/>
Dec 05 13:47:40 user nova-compute[75233]:     <apic/>
Dec 05 13:47:40 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:47:40 user nova-compute[75233]:   </features>
Dec 05 13:47:40 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:47:40 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:47:40 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:47:40 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:47:40 user nova-compute[75233]:   </clock>
Dec 05 13:47:40 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:47:40 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:47:40 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:47:40 user nova-compute[75233]:   </cpu>
Dec 05 13:47:40 user nova-compute[75233]:   <devices>
Dec 05 13:47:40 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:47:40 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:47:40 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk"/>
Dec 05 13:47:40 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:47:40 user nova-compute[75233]:     </disk>
Dec 05 13:47:40 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:47:40 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:47:40 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 13:47:40 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:47:40 user nova-compute[75233]:       <serial>c98a70fc-f8bf-435c-804e-54bafb5cf870</serial>
Dec 05 13:47:40 user nova-compute[75233]:     </disk>
Dec 05 13:47:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:47:40 user nova-compute[75233]:       <mac address="fa:16:3e:84:db:58"/>
Dec 05 13:47:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:47:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:47:40 user nova-compute[75233]:       <target dev="tap217ff3c3-5e"/>
Dec 05 13:47:40 user nova-compute[75233]:     </interface>
Dec 05 13:47:40 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:47:40 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/console.log" append="off"/>
Dec 05 13:47:40 user nova-compute[75233]:     </serial>
Dec 05 13:47:40 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:47:40 user nova-compute[75233]:     <video>
Dec 05 13:47:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:47:40 user nova-compute[75233]:     </video>
Dec 05 13:47:40 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:47:40 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:47:40 user nova-compute[75233]:     </rng>
Dec 05 13:47:40 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:47:40 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:47:40 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:47:40 user nova-compute[75233]:     </memballoon>
Dec 05 13:47:40 user nova-compute[75233]:   </devices>
Dec 05 13:47:40 user nova-compute[75233]: </domain>
Dec 05 13:47:40 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:43:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1343544077-network", "vif_mac": "fa:16:3e:84:db:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG os_vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36de330a-e990-515a-a496-2ad64990ee81', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217ff3c3-5e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap217ff3c3-5e, col_values=(('qos', UUID('2fa0cf74-c3e2-43e4-be1c-c36b5b0ab4dc')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap217ff3c3-5e, col_values=(('external_ids', {'iface-id': '217ff3c3-5eed-435e-b7b1-ec6872e83d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:db:58', 'vm-uuid': 'ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:40 user nova-compute[75233]: INFO os_vif [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e')
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:47:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] No VIF found with MAC fa:16:3e:84:db:58, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:47:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-edd5bfd5-4cb3-43bc-80ac-589ad2d81bd9 req-358e88af-0bcc-491b-b0f0-308489f6aa0f service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-edd5bfd5-4cb3-43bc-80ac-589ad2d81bd9 req-358e88af-0bcc-491b-b0f0-308489f6aa0f service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-edd5bfd5-4cb3-43bc-80ac-589ad2d81bd9 req-358e88af-0bcc-491b-b0f0-308489f6aa0f service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-edd5bfd5-4cb3-43bc-80ac-589ad2d81bd9 req-358e88af-0bcc-491b-b0f0-308489f6aa0f service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-edd5bfd5-4cb3-43bc-80ac-589ad2d81bd9 req-358e88af-0bcc-491b-b0f0-308489f6aa0f service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:42 user nova-compute[75233]: WARNING nova.compute.manager [req-edd5bfd5-4cb3-43bc-80ac-589ad2d81bd9 req-358e88af-0bcc-491b-b0f0-308489f6aa0f service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state active and task_state resize_finish.
Dec 05 13:47:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:47:44 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance running successfully.
Dec 05 13:47:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Failed to set time: agent not configured {{(pid=75233) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-9ce2ad76-5849-4cf1-9d95-d2bbfa36332e tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] finish_migration finished successfully. {{(pid=75233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-9d055b56-5a2a-4488-a9e4-44d66087207b req-09f2b7f0-74be-4143-9edc-86f3c2c69b4b service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d055b56-5a2a-4488-a9e4-44d66087207b req-09f2b7f0-74be-4143-9edc-86f3c2c69b4b service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d055b56-5a2a-4488-a9e4-44d66087207b req-09f2b7f0-74be-4143-9edc-86f3c2c69b4b service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d055b56-5a2a-4488-a9e4-44d66087207b req-09f2b7f0-74be-4143-9edc-86f3c2c69b4b service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-9d055b56-5a2a-4488-a9e4-44d66087207b req-09f2b7f0-74be-4143-9edc-86f3c2c69b4b service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:47:44 user nova-compute[75233]: WARNING nova.compute.manager [req-9d055b56-5a2a-4488-a9e4-44d66087207b req-09f2b7f0-74be-4143-9edc-86f3c2c69b4b service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state active and task_state resize_finish.
Dec 05 13:47:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:47:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:47:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:50 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:50 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.12847137451172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Applying migration context for instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 as it has an incoming, in-progress migration 64f171e0-022e-4e32-b34e-968cb42bd031. Migration status is finished {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 13:47:50 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating resource usage from migration 64f171e0-022e-4e32-b34e-968cb42bd031
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 84e303d2-b587-4574-bd33-d682e74289a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance c1cdc84b-3fe7-4965-8e2e-9c202d372274 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b4b42e4d-f5e2-48ec-842a-536a1f250585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Migration 64f171e0-022e-4e32-b34e-968cb42bd031 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 4f0cc131-8133-40a7-b331-6c87051b7646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:47:50 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:47:51 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:47:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:47:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:47:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:47:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:47:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:47:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:47:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:47:55 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:47:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:47:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:47:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:47:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:48:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:48:04 user nova-compute[75233]: INFO nova.compute.claims [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Claim successful on node user
Dec 05 13:48:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:48:05 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:48:05 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Creating image(s)
Dec 05 13:48:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:05 user nova-compute[75233]: DEBUG nova.policy [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5414614ea59f4b26938bf55a492e5ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405f4ac4b28d405fb6f71f29c6557517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.200s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.208s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk 1073741824" returned: 0 in 0.066s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.210s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Cannot resize image /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Ensure instance console log exists: /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Successfully created port: 7620b802-6381-4721-a397-881e11466092 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Successfully updated port: 7620b802-6381-4721-a397-881e11466092 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquired lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-changed-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Refreshing instance network info cache due to event network-changed-7620b802-6381-4721-a397-881e11466092. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] Acquiring lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updating instance_info_cache with network_info: [{"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Releasing lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance network_info: |[{"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] Acquired lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Refreshing network info cache for port 7620b802-6381-4721-a397-881e11466092 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Start _get_guest_xml network_info=[{"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:48:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1578695365',display_name='tempest-tempest.common.compute-instance-1578695365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1578695365',id=23,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2aipfGk9HZY+V9iR6F0Sb1fi8n5MWQBWblZVcpCDCSsj+DE07vFNMf3l17q6NduKyPOjiOyJyh0mIGrWeTQ3Ko/XAtOQSdBAislQFq4jImzaXh1gAjPT/8p5R03T9rA==',key_name='tempest-keypair-798902531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-dr7was46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=fba66d11-7258-45dd-9d43-d6243d334d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'pci_devices' on Instance uuid fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:48:09 user nova-compute[75233]:   <uuid>fba66d11-7258-45dd-9d43-d6243d334d16</uuid>
Dec 05 13:48:09 user nova-compute[75233]:   <name>instance-00000017</name>
Dec 05 13:48:09 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:48:09 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:48:09 user nova-compute[75233]:   <metadata>
Dec 05 13:48:09 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:48:09 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:48:09 user nova-compute[75233]:       <nova:name>tempest-tempest.common.compute-instance-1578695365</nova:name>
Dec 05 13:48:09 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:48:08</nova:creationTime>
Dec 05 13:48:09 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:48:09 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:48:09 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:48:09 user nova-compute[75233]:       <nova:owner>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:user uuid="5414614ea59f4b26938bf55a492e5ddd">tempest-ServerActionsTestOtherA-875899137-project-member</nova:user>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:project uuid="405f4ac4b28d405fb6f71f29c6557517">tempest-ServerActionsTestOtherA-875899137</nova:project>
Dec 05 13:48:09 user nova-compute[75233]:       </nova:owner>
Dec 05 13:48:09 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:48:09 user nova-compute[75233]:       <nova:ports>
Dec 05 13:48:09 user nova-compute[75233]:         <nova:port uuid="7620b802-6381-4721-a397-881e11466092">
Dec 05 13:48:09 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 13:48:09 user nova-compute[75233]:         </nova:port>
Dec 05 13:48:09 user nova-compute[75233]:       </nova:ports>
Dec 05 13:48:09 user nova-compute[75233]:     </nova:instance>
Dec 05 13:48:09 user nova-compute[75233]:   </metadata>
Dec 05 13:48:09 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:48:09 user nova-compute[75233]:     <system>
Dec 05 13:48:09 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:48:09 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:48:09 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:48:09 user nova-compute[75233]:       <entry name="serial">fba66d11-7258-45dd-9d43-d6243d334d16</entry>
Dec 05 13:48:09 user nova-compute[75233]:       <entry name="uuid">fba66d11-7258-45dd-9d43-d6243d334d16</entry>
Dec 05 13:48:09 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:48:09 user nova-compute[75233]:     </system>
Dec 05 13:48:09 user nova-compute[75233]:   </sysinfo>
Dec 05 13:48:09 user nova-compute[75233]:   <os>
Dec 05 13:48:09 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:48:09 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:48:09 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:48:09 user nova-compute[75233]:   </os>
Dec 05 13:48:09 user nova-compute[75233]:   <features>
Dec 05 13:48:09 user nova-compute[75233]:     <acpi/>
Dec 05 13:48:09 user nova-compute[75233]:     <apic/>
Dec 05 13:48:09 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:48:09 user nova-compute[75233]:   </features>
Dec 05 13:48:09 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:48:09 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:48:09 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:48:09 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:48:09 user nova-compute[75233]:   </clock>
Dec 05 13:48:09 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:48:09 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:48:09 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:48:09 user nova-compute[75233]:   </cpu>
Dec 05 13:48:09 user nova-compute[75233]:   <devices>
Dec 05 13:48:09 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:48:09 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:48:09 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk"/>
Dec 05 13:48:09 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:48:09 user nova-compute[75233]:     </disk>
Dec 05 13:48:09 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:48:09 user nova-compute[75233]:       <mac address="fa:16:3e:a5:38:cd"/>
Dec 05 13:48:09 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:48:09 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:48:09 user nova-compute[75233]:       <target dev="tap7620b802-63"/>
Dec 05 13:48:09 user nova-compute[75233]:     </interface>
Dec 05 13:48:09 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:48:09 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/console.log" append="off"/>
Dec 05 13:48:09 user nova-compute[75233]:     </serial>
Dec 05 13:48:09 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:48:09 user nova-compute[75233]:     <video>
Dec 05 13:48:09 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:48:09 user nova-compute[75233]:     </video>
Dec 05 13:48:09 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:48:09 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:48:09 user nova-compute[75233]:     </rng>
Dec 05 13:48:09 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:48:09 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:48:09 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:48:09 user nova-compute[75233]:     </memballoon>
Dec 05 13:48:09 user nova-compute[75233]:   </devices>
Dec 05 13:48:09 user nova-compute[75233]: </domain>
Dec 05 13:48:09 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1578695365',display_name='tempest-tempest.common.compute-instance-1578695365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1578695365',id=23,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2aipfGk9HZY+V9iR6F0Sb1fi8n5MWQBWblZVcpCDCSsj+DE07vFNMf3l17q6NduKyPOjiOyJyh0mIGrWeTQ3Ko/XAtOQSdBAislQFq4jImzaXh1gAjPT/8p5R03T9rA==',key_name='tempest-keypair-798902531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-dr7was46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=fba66d11-7258-45dd-9d43-d6243d334d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG os_vif [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0122abfa-7de4-5c7f-bc1f-70f800c5a44c', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7620b802-63, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7620b802-63, col_values=(('qos', UUID('bdb2899f-64b7-4e10-8804-31f3b75da36a')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7620b802-63, col_values=(('external_ids', {'iface-id': '7620b802-6381-4721-a397-881e11466092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:38:cd', 'vm-uuid': 'fba66d11-7258-45dd-9d43-d6243d334d16'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:09 user nova-compute[75233]: INFO os_vif [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63')
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No VIF found with MAC fa:16:3e:a5:38:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updated VIF entry in instance network info cache for port 7620b802-6381-4721-a397-881e11466092. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updating instance_info_cache with network_info: [{"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1100693b-e39f-4918-9ce3-a03e241f7928 req-763a4a9b-7b8d-40ce-92ff-40051f736e26 service nova] Releasing lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-25b29d9c-f64c-4194-86d9-2901be1b9315 req-954cb002-1b0f-498e-814a-c243ca5a6342 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-25b29d9c-f64c-4194-86d9-2901be1b9315 req-954cb002-1b0f-498e-814a-c243ca5a6342 service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-25b29d9c-f64c-4194-86d9-2901be1b9315 req-954cb002-1b0f-498e-814a-c243ca5a6342 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-25b29d9c-f64c-4194-86d9-2901be1b9315 req-954cb002-1b0f-498e-814a-c243ca5a6342 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.018s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-25b29d9c-f64c-4194-86d9-2901be1b9315 req-954cb002-1b0f-498e-814a-c243ca5a6342 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:10 user nova-compute[75233]: WARNING nova.compute.manager [req-25b29d9c-f64c-4194-86d9-2901be1b9315 req-954cb002-1b0f-498e-814a-c243ca5a6342 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state building and task_state spawning.
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:48:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance spawned successfully.
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-fab1b6d8-d4f1-4360-b420-e7845e1fb56f req-96eef67b-642f-4b3c-b0c2-47e8df13c547 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fab1b6d8-d4f1-4360-b420-e7845e1fb56f req-96eef67b-642f-4b3c-b0c2-47e8df13c547 service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fab1b6d8-d4f1-4360-b420-e7845e1fb56f req-96eef67b-642f-4b3c-b0c2-47e8df13c547 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fab1b6d8-d4f1-4360-b420-e7845e1fb56f req-96eef67b-642f-4b3c-b0c2-47e8df13c547 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-fab1b6d8-d4f1-4360-b420-e7845e1fb56f req-96eef67b-642f-4b3c-b0c2-47e8df13c547 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:12 user nova-compute[75233]: WARNING nova.compute.manager [req-fab1b6d8-d4f1-4360-b420-e7845e1fb56f req-96eef67b-642f-4b3c-b0c2-47e8df13c547 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state building and task_state spawning.
Dec 05 13:48:12 user nova-compute[75233]: INFO nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Took 7.00 seconds to spawn the instance on the hypervisor.
Dec 05 13:48:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:48:12 user nova-compute[75233]: INFO nova.compute.manager [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Took 8.07 seconds to build instance.
Dec 05 13:48:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e707705-616c-4614-95bf-b9065c751707 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.212s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-changed-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Refreshing instance network info cache due to event network-changed-fa063bc7-cc2e-44b9-99b5-723c5ce240cf. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:48:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] Acquiring lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] Acquired lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Refreshing network info cache for port fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updated VIF entry in instance network info cache for port fa063bc7-cc2e-44b9-99b5-723c5ce240cf. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updating instance_info_cache with network_info: [{"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-266bf4e2-24b9-42d8-b625-79cbc2d3cc6a req-60529b56-244e-4ddb-a5bb-a848368617c6 service nova] Releasing lock "refresh_cache-84e303d2-b587-4574-bd33-d682e74289a9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'flavor' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:14 user nova-compute[75233]: INFO nova.compute.manager [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attaching volume 6220ccb4-1144-4c73-a00b-4915ad5a2bf9 to /dev/vdb
Dec 05 13:48:14 user nova-compute[75233]: DEBUG os_brick.utils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ef19e-e0a3-4471-beaa-6cbf1ed2b082]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda4b8f0-610b-4087-ada8-49d2846bfcfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[417785eb-8d63-4a08-8e11-3b1bf2d04440]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d23bba-e5fc-40a9-abc9-f1a80dd9be57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:48:14 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:48:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b4fabe-c50d-4e77-9689-2742f4651613]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG os_brick.utils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updating existing volume attachment record: a209e4c0-bac7-42d5-bcb0-36624e3bde83 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:48:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG nova.objects.instance [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lazy-loading 'flavor' on Instance uuid c1cdc84b-3fe7-4965-8e2e-9c202d372274 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:15 user nova-compute[75233]: INFO nova.compute.manager [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Attaching volume 2e9fbaaf-157c-4c09-9e66-857588f966c5 to /dev/vdb
Dec 05 13:48:15 user nova-compute[75233]: DEBUG os_brick.utils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4206eb6-b51e-4ed5-b03f-e2c3a0dd672c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a7cfb-fed8-452a-b2ad-65e2648846de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[412d9408-2011-4d4b-aca3-99cd03c6f883]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef03d0c-7d7f-4a48-972e-f398457d9a19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:48:15 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:48:15 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80316ae4-7379-47bb-ad36-79d2419e1bef]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG os_brick.utils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:15 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Updating existing volume attachment record: cdfbba80-f131-4480-a30f-88d3b3844aa4 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:48:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:48:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:21 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:48:21 user nova-compute[75233]: INFO nova.compute.claims [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Claim successful on node user
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:48:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.policy [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8931693fe9346ac97541fe654e0da80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23dfcfe066146e68199294937623f56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:48:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Creating image(s)
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "/opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "/opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk 1073741824" returned: 0 in 0.052s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Successfully created port: 236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Cannot resize image /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Ensure instance console log exists: /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Successfully updated port: 236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquired lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-changed-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Refreshing instance network info cache due to event network-changed-236f8926-bbb2-4319-9d65-ca9c4e149d29. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] Acquiring lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updating instance_info_cache with network_info: [{"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Releasing lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Instance network_info: |[{"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] Acquired lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.neutron [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Refreshing network info cache for port 236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Start _get_guest_xml network_info=[{"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:48:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2027825',id=24,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7yQnkgs1h3pq21nT3f1cvnXTumaK1m590C6aXwPpVACYZM2Mpnv4g0XoE3gN/+ddux6PII6viJ9fctaRyoP4Abh1w3dQWKSJx/XKEJCDpex1yaPNCIwBbh3y7QRt9RpA==',key_name='tempest-keypair-1041485488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d23dfcfe066146e68199294937623f56',ramdisk_id='',reservation_id='r-qzpzlh98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-315527834',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8931693fe9346ac97541fe654e0da80',uuid=fc9d177a-43bf-4644-bc62-f7203019d911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Converting VIF {"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9d177a-43bf-4644-bc62-f7203019d911 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:48:24 user nova-compute[75233]:   <uuid>fc9d177a-43bf-4644-bc62-f7203019d911</uuid>
Dec 05 13:48:24 user nova-compute[75233]:   <name>instance-00000018</name>
Dec 05 13:48:24 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:48:24 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:48:24 user nova-compute[75233]:   <metadata>
Dec 05 13:48:24 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:48:24 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:48:24 user nova-compute[75233]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527</nova:name>
Dec 05 13:48:24 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:48:24</nova:creationTime>
Dec 05 13:48:24 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:48:24 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:48:24 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:48:24 user nova-compute[75233]:       <nova:owner>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:user uuid="e8931693fe9346ac97541fe654e0da80">tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member</nova:user>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:project uuid="d23dfcfe066146e68199294937623f56">tempest-TestServerVolumeAttachScenarioOldVersion-315527834</nova:project>
Dec 05 13:48:24 user nova-compute[75233]:       </nova:owner>
Dec 05 13:48:24 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:48:24 user nova-compute[75233]:       <nova:ports>
Dec 05 13:48:24 user nova-compute[75233]:         <nova:port uuid="236f8926-bbb2-4319-9d65-ca9c4e149d29">
Dec 05 13:48:24 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 13:48:24 user nova-compute[75233]:         </nova:port>
Dec 05 13:48:24 user nova-compute[75233]:       </nova:ports>
Dec 05 13:48:24 user nova-compute[75233]:     </nova:instance>
Dec 05 13:48:24 user nova-compute[75233]:   </metadata>
Dec 05 13:48:24 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:48:24 user nova-compute[75233]:     <system>
Dec 05 13:48:24 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:48:24 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:48:24 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:48:24 user nova-compute[75233]:       <entry name="serial">fc9d177a-43bf-4644-bc62-f7203019d911</entry>
Dec 05 13:48:24 user nova-compute[75233]:       <entry name="uuid">fc9d177a-43bf-4644-bc62-f7203019d911</entry>
Dec 05 13:48:24 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:48:24 user nova-compute[75233]:     </system>
Dec 05 13:48:24 user nova-compute[75233]:   </sysinfo>
Dec 05 13:48:24 user nova-compute[75233]:   <os>
Dec 05 13:48:24 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:48:24 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:48:24 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:48:24 user nova-compute[75233]:   </os>
Dec 05 13:48:24 user nova-compute[75233]:   <features>
Dec 05 13:48:24 user nova-compute[75233]:     <acpi/>
Dec 05 13:48:24 user nova-compute[75233]:     <apic/>
Dec 05 13:48:24 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:48:24 user nova-compute[75233]:   </features>
Dec 05 13:48:24 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:48:24 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:48:24 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:48:24 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:48:24 user nova-compute[75233]:   </clock>
Dec 05 13:48:24 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:48:24 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:48:24 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:48:24 user nova-compute[75233]:   </cpu>
Dec 05 13:48:24 user nova-compute[75233]:   <devices>
Dec 05 13:48:24 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:48:24 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:48:24 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk"/>
Dec 05 13:48:24 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:48:24 user nova-compute[75233]:     </disk>
Dec 05 13:48:24 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:48:24 user nova-compute[75233]:       <mac address="fa:16:3e:20:df:df"/>
Dec 05 13:48:24 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:48:24 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:48:24 user nova-compute[75233]:       <target dev="tap236f8926-bb"/>
Dec 05 13:48:24 user nova-compute[75233]:     </interface>
Dec 05 13:48:24 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:48:24 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/console.log" append="off"/>
Dec 05 13:48:24 user nova-compute[75233]:     </serial>
Dec 05 13:48:24 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:48:24 user nova-compute[75233]:     <video>
Dec 05 13:48:24 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:48:24 user nova-compute[75233]:     </video>
Dec 05 13:48:24 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:48:24 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:48:24 user nova-compute[75233]:     </rng>
Dec 05 13:48:24 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:48:24 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:48:24 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:48:24 user nova-compute[75233]:     </memballoon>
Dec 05 13:48:24 user nova-compute[75233]:   </devices>
Dec 05 13:48:24 user nova-compute[75233]: </domain>
Dec 05 13:48:24 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2027825',id=24,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7yQnkgs1h3pq21nT3f1cvnXTumaK1m590C6aXwPpVACYZM2Mpnv4g0XoE3gN/+ddux6PII6viJ9fctaRyoP4Abh1w3dQWKSJx/XKEJCDpex1yaPNCIwBbh3y7QRt9RpA==',key_name='tempest-keypair-1041485488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d23dfcfe066146e68199294937623f56',ramdisk_id='',reservation_id='r-qzpzlh98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-315527834',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8931693fe9346ac97541fe654e0da80',uuid=fc9d177a-43bf-4644-bc62-f7203019d911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Converting VIF {"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG os_vif [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8074711c-d72f-5efb-9bdf-a2a4a021f012', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap236f8926-bb, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap236f8926-bb, col_values=(('qos', UUID('6b0f473a-a2f1-409d-a46f-427e2ad47dc1')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap236f8926-bb, col_values=(('external_ids', {'iface-id': '236f8926-bbb2-4319-9d65-ca9c4e149d29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:df:df', 'vm-uuid': 'fc9d177a-43bf-4644-bc62-f7203019d911'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:24 user nova-compute[75233]: INFO os_vif [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb')
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] No VIF found with MAC fa:16:3e:20:df:df, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.neutron [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updated VIF entry in instance network info cache for port 236f8926-bbb2-4319-9d65-ca9c4e149d29. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG nova.network.neutron [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updating instance_info_cache with network_info: [{"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a2ffc686-d0e7-4e22-8a2d-d6bc134b3541 req-0a658f2a-b451-48b5-982b-4ded87211e2a service nova] Releasing lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUxZIezS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:26 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76752ea-06a8-495c-965b-ac999f9287ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:48:26 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjlzNrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[46672fab-09ea-4451-818d-39f4572a8074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9] added
Dec 05 13:48:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8339f14d-38c7-4143-b775-ca2b2c4ffe38]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3743d-3f87-4807-ae4a-c6292ace8a37]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUxZIezS {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUxZIezS" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33d4ccd-c79b-4392-8e38-c2f7c036c52c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUxZIezS'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc390a-98fd-4b16-9b6a-ac5452556cc8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-a0135e96-1386-43c0-a230-fb665a081e89 req-a9e97b56-79ee-4d25-b49b-9901bc342641 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a0135e96-1386-43c0-a230-fb665a081e89 req-a9e97b56-79ee-4d25-b49b-9901bc342641 service nova] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a0135e96-1386-43c0-a230-fb665a081e89 req-a9e97b56-79ee-4d25-b49b-9901bc342641 service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a0135e96-1386-43c0-a230-fb665a081e89 req-a9e97b56-79ee-4d25-b49b-9901bc342641 service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-a0135e96-1386-43c0-a230-fb665a081e89 req-a9e97b56-79ee-4d25-b49b-9901bc342641 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] No waiting events found dispatching network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:26 user nova-compute[75233]: WARNING nova.compute.manager [req-a0135e96-1386-43c0-a230-fb665a081e89 req-a9e97b56-79ee-4d25-b49b-9901bc342641 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received unexpected event network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 for instance with vm_state building and task_state spawning.
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6d4c5-677c-49ee-b715-7b99fffa3cb7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:26 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:26 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda72c3-9306-4b63-9aa5-cb5be83d475f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260]
Dec 05 13:48:26 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260] successful.
Dec 05 13:48:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4833e60-bdd5-4869-b03d-8bb1ac575eb0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[00210167-4f9e-433e-ba0c-5bcc830e9bae]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:26 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:26 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:26 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:26 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[09269e5a-d522-4f4e-83b4-d4c5104141bb]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUxZIezS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26134636239353561', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134636239353561', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.353s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:27 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'flavor' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03742bef-8fca-483c-b01c-3d67da51b19b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:48:27 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ca878-de65-4185-aa9e-263406523105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5] added
Dec 05 13:48:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:48:27 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:48:27 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:48:27 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:48:27 user nova-compute[75233]:   <serial>6220ccb4-1144-4c73-a00b-4915ad5a2bf9</serial>
Dec 05 13:48:27 user nova-compute[75233]: </disk>
Dec 05 13:48:27 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b700a4-5c3d-4e65-abfa-6ec1c65d78ea]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[01805924-504c-4eeb-890c-bc153344d8c1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsjlzNrv {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsjlzNrv" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22fec68-fe3c-417d-a43c-bb72df42da1e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsjlzNrv'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6cd52-be8e-42ce-a329-6b414e230b79]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f550f846-6fde-4f24-afa4-fd60369ae83d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:27 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:27 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:27 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:27 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No VIF found with MAC fa:16:3e:b0:f9:be, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0a32c21c-6ea3-4cae-8fb2-2cb4fb7b6071 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.480s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-c2f74264-3327-44b2-a291-25bdf6f73561 req-cbb9258a-c236-4c9e-9860-bd21c6d76dfd service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c2f74264-3327-44b2-a291-25bdf6f73561 req-cbb9258a-c236-4c9e-9860-bd21c6d76dfd service nova] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c2f74264-3327-44b2-a291-25bdf6f73561 req-cbb9258a-c236-4c9e-9860-bd21c6d76dfd service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c2f74264-3327-44b2-a291-25bdf6f73561 req-cbb9258a-c236-4c9e-9860-bd21c6d76dfd service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-c2f74264-3327-44b2-a291-25bdf6f73561 req-cbb9258a-c236-4c9e-9860-bd21c6d76dfd service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] No waiting events found dispatching network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:28 user nova-compute[75233]: WARNING nova.compute.manager [req-c2f74264-3327-44b2-a291-25bdf6f73561 req-cbb9258a-c236-4c9e-9860-bd21c6d76dfd service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received unexpected event network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 for instance with vm_state building and task_state spawning.
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:48:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Instance spawned successfully.
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:48:28 user nova-compute[75233]: INFO nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Took 6.30 seconds to spawn the instance on the hypervisor.
Dec 05 13:48:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --login" returned: 0 in 1.066s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfc4051-66e3-4990-aac6-42fd5223c127]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260]
Dec 05 13:48:28 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260] successful.
Dec 05 13:48:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcff54f4-ac25-4313-886e-660d1442338f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:28 user nova-compute[75233]: INFO nova.compute.manager [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Took 7.21 seconds to build instance.
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688b0f5-9687-4201-8ea6-e7740bf2844b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:28 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:28 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:28 user nova-compute[75233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)
Dec 05 13:48:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:28 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:28 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:28 user nova-compute[75233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)
Dec 05 13:48:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.335s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fde9a411-0c96-46a2-a24a-9d6761137c48 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.342s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e61808c-2571-4b69-8d9e-f69dffb15fb1]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:48:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjlzNrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.389s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] <== connect_volume: return (3742ms) {'type': 'block', 'scsi_wwn': '23665656363353061', 'path': '/dev/sde'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665656363353061', 'path': '/dev/sde'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG nova.objects.instance [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lazy-loading 'flavor' on Instance uuid c1cdc84b-3fe7-4965-8e2e-9c202d372274 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:48:29 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:48:29 user nova-compute[75233]:   <source dev="/dev/sde"/>
Dec 05 13:48:29 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:48:29 user nova-compute[75233]:   <serial>2e9fbaaf-157c-4c09-9e66-857588f966c5</serial>
Dec 05 13:48:29 user nova-compute[75233]: </disk>
Dec 05 13:48:29 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:48:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] No VIF found with MAC fa:16:3e:72:1b:5f, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-50b76d3c-f74d-412f-a637-b12f0d854ab7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.859s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.network.neutron [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'info_cache' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:30 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:31 user nova-compute[75233]: INFO nova.compute.manager [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Terminating instance
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-caa5b23c-7550-42e2-94fd-7c409e587a16 req-91ca5dca-e0bd-4ff9-9e6f-c3795126bead service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-vif-unplugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-caa5b23c-7550-42e2-94fd-7c409e587a16 req-91ca5dca-e0bd-4ff9-9e6f-c3795126bead service nova] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-caa5b23c-7550-42e2-94fd-7c409e587a16 req-91ca5dca-e0bd-4ff9-9e6f-c3795126bead service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-caa5b23c-7550-42e2-94fd-7c409e587a16 req-91ca5dca-e0bd-4ff9-9e6f-c3795126bead service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-caa5b23c-7550-42e2-94fd-7c409e587a16 req-91ca5dca-e0bd-4ff9-9e6f-c3795126bead service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] No waiting events found dispatching network-vif-unplugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-caa5b23c-7550-42e2-94fd-7c409e587a16 req-91ca5dca-e0bd-4ff9-9e6f-c3795126bead service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-vif-unplugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance destroyed successfully.
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'resources' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG os_vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99da560f-01, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2335ab94-0726-40fb-a3de-e99de7d54510) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Instance destroyed successfully.
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lazy-loading 'resources' on Instance uuid c1cdc84b-3fe7-4965-8e2e-9c202d372274 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:31 user nova-compute[75233]: INFO os_vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01')
Dec 05 13:48:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:31 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-490306908',display_name='tempest-DeleteServersTestJSON-server-490306908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-490306908',id=20,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:46:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27e17ec7e000470e9c2a0d58119f25e3',ramdisk_id='',reservation_id='r-7a5hlqpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1495418042',owner_user_name='tempest-DeleteServersTestJSON-1495418042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:46:31Z,user_data=None,user_id='933c647e356948fc9c47ca719629fa1e',uuid=c1cdc84b-3fe7-4965-8e2e-9c202d372274,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Converting VIF {"id": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "address": "fa:16:3e:72:1b:5f", "network": {"id": "9669bfea-0fc1-4b40-a3e4-dcb774f10bf9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-541724865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27e17ec7e000470e9c2a0d58119f25e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79466a7d-f5", "ovs_interfaceid": "79466a7d-f58c-4226-b2b3-3db4a88c3fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_vif [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79466a7d-f5, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77f49e5e-35bb-499c-9b54-3902305c9fab) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f6072-1f19-4d11-af57-bbdda05771f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:48:32 user nova-compute[75233]: No targets found.
Dec 05 13:48:32 user nova-compute[75233]: iSNS:
Dec 05 13:48:32 user nova-compute[75233]: No targets found.
Dec 05 13:48:32 user nova-compute[75233]: STATIC:
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: FIRMWARE:
Dec 05 13:48:32 user nova-compute[75233]: No targets found.
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:48:32 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:48:32 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: INFO os_vif [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:1b:5f,bridge_name='br-int',has_traffic_filtering=True,id=79466a7d-f58c-4226-b2b3-3db4a88c3fd2,network=Network(9669bfea-0fc1-4b40-a3e4-dcb774f10bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79466a7d-f5')
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsjlzNrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66a1f0-fbd8-4566-94f6-f5aa613319c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6074e9c-7a41-424b-9533-c69353f341d5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34743be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1adfe4-8d53-4860-b0e8-0712a1a8ac95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fd562-0b45-4ec5-9a23-bb25a91e5afa]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97db10a7-08af-4c60-b57e-36c00f6ab8e7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb2b90-9dbc-4083-baf3-fa3ac9e4af5c]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba99f1-d237-405a-9a34-308f86ff06af]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0618f144-1ca6-4a2d-87df-b31390d078db]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]
Dec 05 13:48:32 user nova-compute[75233]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d018f-7247-4fcc-8db5-f3680076d1ed]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== disconnect_volume: return (326ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.283s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start _get_guest_xml network_info=[{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '47d20f82-0294-43b9-97a3-7ae8c564d08d', 'attached_at': '', 'detached_at': '', 'volume_id': '1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'serial': '1c48c470-ff2e-4d63-9fcf-9199c5a5741c'}, 'delete_on_termination': False, 'attachment_id': '536f3174-7195-48f8-acef-6ddfa369bca4', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'numa_topology' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d52fa-507f-40c4-a7ce-93969be2ccc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:48:32 user nova-compute[75233]: No targets found.
Dec 05 13:48:32 user nova-compute[75233]: iSNS:
Dec 05 13:48:32 user nova-compute[75233]: No targets found.
Dec 05 13:48:32 user nova-compute[75233]: STATIC:
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:48:32 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:48:32 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:48:32 user nova-compute[75233]: FIRMWARE:
Dec 05 13:48:32 user nova-compute[75233]: No targets found.
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:48:32 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:48:32 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b8868f-7a10-42a7-8201-42534d5853f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1d1be-6354-407b-b345-0d625a8dccd5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34740af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5'): ({'sde'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Removing single pathed devices sde {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9679e161-2719-4ddc-a3be-edbe9f8dfeb8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4843e947-a09c-4108-bf4a-b897af31ef7d]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Flushing IO for device /dev/sde {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebd3581-a973-40bc-95ce-bc67d194c173]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[800efcb7-a642-466b-bd75-e2da244a6aa5]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b5b988-72a0-44cd-8005-04a75a1643b1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a987ee-17e5-41c9-8bd7-c3e2abaa459d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260]
Dec 05 13:48:32 user nova-compute[75233]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5, portal: 172.16.0.220,3260] successful.
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9fbaaf-157c-4c09-9e66-857588f966c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff8f81-90d6-41fc-8f87-1269e5f0e532]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] <== disconnect_volume: return (645ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:48:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Deleting instance files /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274_del
Dec 05 13:48:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Deletion of /opt/stack/data/nova/instances/c1cdc84b-3fe7-4965-8e2e-9c202d372274_del complete
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.269s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:32 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacca985-e674-43c6-ac20-f81e59ea5da2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:48:32 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15710ac7-e34e-4814-b40e-251cd7b976ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c] added
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: INFO nova.compute.manager [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Took 1.58 seconds to destroy the instance on the hypervisor.
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a50694-9c63-45c2-bad3-c0ea7ca2dfe5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cdb2c0-4fbc-418c-89c0-8b02d45888cc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyOjtDNb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyOjtDNb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[206737cf-c14d-4cf9-bcca-cb7eca41b333]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyOjtDNb'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee7761e-9b79-49fe-8286-b3eabd623a27]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5007d-1471-4cdf-a3c4-168bd6778525]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'flavor' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bbd86d-d774-4bfe-8143-f5bd50c7754f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]
Dec 05 13:48:32 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.
Dec 05 13:48:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0aec2d-3851-41c0-b388-2d49316959ac]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a8234-41e7-4052-aa94-046faf89082e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:33 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:33 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:33 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:33 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be14c2-75f7-4989-8090-a3dec16a3380]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:33 user nova-compute[75233]: INFO nova.compute.manager [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attaching volume d16bba44-7e16-4b2e-80e1-94f440989827 to /dev/vdc
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.utils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f492d9-5d80-4f07-a56f-7ee5e81d44b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Took 0.50 seconds to deallocate network for instance.
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a4a353-5910-4476-97c5-775dbfbf7664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-171a2e46-6210-4ab7-beea-b828734dd06d req-957dcd61-2803-4371-8d02-6bb736b861a4 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-vif-deleted-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a82266-4165-41ed-a5ec-1bfc2815308c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[170c845f-7341-4731-8904-e5fed2149cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:48:33 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efb796e-31a5-4628-ac93-ce2917852d71]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG os_brick.utils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updating existing volume attachment record: be6e68ea-ad5f-425b-a5d0-a45df667f076 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-57fbb6bb-4121-4f28-bde9-ed30400c54b9 req-967a5e8f-6b11-4b6b-98ab-88c1c0294669 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received event network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-57fbb6bb-4121-4f28-bde9-ed30400c54b9 req-967a5e8f-6b11-4b6b-98ab-88c1c0294669 service nova] Acquiring lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-57fbb6bb-4121-4f28-bde9-ed30400c54b9 req-967a5e8f-6b11-4b6b-98ab-88c1c0294669 service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-57fbb6bb-4121-4f28-bde9-ed30400c54b9 req-967a5e8f-6b11-4b6b-98ab-88c1c0294669 service nova] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-57fbb6bb-4121-4f28-bde9-ed30400c54b9 req-967a5e8f-6b11-4b6b-98ab-88c1c0294669 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] No waiting events found dispatching network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:33 user nova-compute[75233]: WARNING nova.compute.manager [req-57fbb6bb-4121-4f28-bde9-ed30400c54b9 req-967a5e8f-6b11-4b6b-98ab-88c1c0294669 service nova] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Received unexpected event network-vif-plugged-79466a7d-f58c-4226-b2b3-3db4a88c3fd2 for instance with vm_state active and task_state deleting.
Dec 05 13:48:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== connect_volume: return (1619ms) {'type': 'block', 'scsi_wwn': '23661353462316431', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661353462316431', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'pci_devices' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:48:34 user nova-compute[75233]:   <uuid>47d20f82-0294-43b9-97a3-7ae8c564d08d</uuid>
Dec 05 13:48:34 user nova-compute[75233]:   <name>instance-00000012</name>
Dec 05 13:48:34 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:48:34 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:48:34 user nova-compute[75233]:   <metadata>
Dec 05 13:48:34 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:48:34 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:48:34 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeTestJSON-server-460475358</nova:name>
Dec 05 13:48:34 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:48:32</nova:creationTime>
Dec 05 13:48:34 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:48:34 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:48:34 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:48:34 user nova-compute[75233]:       <nova:owner>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:user uuid="a6a3445087d842fc9279e2472759bf1f">tempest-AttachVolumeTestJSON-1807043870-project-member</nova:user>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:project uuid="14235050c7d84ebb8ff12ff245c35fec">tempest-AttachVolumeTestJSON-1807043870</nova:project>
Dec 05 13:48:34 user nova-compute[75233]:       </nova:owner>
Dec 05 13:48:34 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:48:34 user nova-compute[75233]:       <nova:ports>
Dec 05 13:48:34 user nova-compute[75233]:         <nova:port uuid="99da560f-01fc-4f4c-81f8-7d3a72dc8d45">
Dec 05 13:48:34 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 13:48:34 user nova-compute[75233]:         </nova:port>
Dec 05 13:48:34 user nova-compute[75233]:       </nova:ports>
Dec 05 13:48:34 user nova-compute[75233]:     </nova:instance>
Dec 05 13:48:34 user nova-compute[75233]:   </metadata>
Dec 05 13:48:34 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:48:34 user nova-compute[75233]:     <system>
Dec 05 13:48:34 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:48:34 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:48:34 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:48:34 user nova-compute[75233]:       <entry name="serial">47d20f82-0294-43b9-97a3-7ae8c564d08d</entry>
Dec 05 13:48:34 user nova-compute[75233]:       <entry name="uuid">47d20f82-0294-43b9-97a3-7ae8c564d08d</entry>
Dec 05 13:48:34 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:48:34 user nova-compute[75233]:     </system>
Dec 05 13:48:34 user nova-compute[75233]:   </sysinfo>
Dec 05 13:48:34 user nova-compute[75233]:   <os>
Dec 05 13:48:34 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:48:34 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:48:34 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:48:34 user nova-compute[75233]:   </os>
Dec 05 13:48:34 user nova-compute[75233]:   <features>
Dec 05 13:48:34 user nova-compute[75233]:     <acpi/>
Dec 05 13:48:34 user nova-compute[75233]:     <apic/>
Dec 05 13:48:34 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:48:34 user nova-compute[75233]:   </features>
Dec 05 13:48:34 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:48:34 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:48:34 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:48:34 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:48:34 user nova-compute[75233]:   </clock>
Dec 05 13:48:34 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:48:34 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:48:34 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:48:34 user nova-compute[75233]:   </cpu>
Dec 05 13:48:34 user nova-compute[75233]:   <devices>
Dec 05 13:48:34 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:48:34 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:48:34 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk"/>
Dec 05 13:48:34 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:48:34 user nova-compute[75233]:     </disk>
Dec 05 13:48:34 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:48:34 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:48:34 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 13:48:34 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:48:34 user nova-compute[75233]:       <serial>1c48c470-ff2e-4d63-9fcf-9199c5a5741c</serial>
Dec 05 13:48:34 user nova-compute[75233]:     </disk>
Dec 05 13:48:34 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:48:34 user nova-compute[75233]:       <mac address="fa:16:3e:d5:3a:57"/>
Dec 05 13:48:34 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:48:34 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:48:34 user nova-compute[75233]:       <target dev="tap99da560f-01"/>
Dec 05 13:48:34 user nova-compute[75233]:     </interface>
Dec 05 13:48:34 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:48:34 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/console.log" append="off"/>
Dec 05 13:48:34 user nova-compute[75233]:     </serial>
Dec 05 13:48:34 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:48:34 user nova-compute[75233]:     <video>
Dec 05 13:48:34 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:48:34 user nova-compute[75233]:     </video>
Dec 05 13:48:34 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:48:34 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:48:34 user nova-compute[75233]:     </rng>
Dec 05 13:48:34 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:48:34 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:48:34 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:48:34 user nova-compute[75233]:     </memballoon>
Dec 05 13:48:34 user nova-compute[75233]:   </devices>
Dec 05 13:48:34 user nova-compute[75233]: </domain>
Dec 05 13:48:34 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:34 user nova-compute[75233]: INFO nova.compute.manager [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] [instance: c1cdc84b-3fe7-4965-8e2e-9c202d372274] Took 0.97 seconds to detach 1 volumes for instance.
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:48:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Cannot resize image /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'migration_context' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG nova.objects.base [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG os_vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c21130e1-59cf-58e9-9a14-1dd30573fb0a', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99da560f-01, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99da560f-01, col_values=(('qos', UUID('88f9de73-9fa3-44e4-82d7-7afccf2342cd')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99da560f-01, col_values=(('external_ids', {'iface-id': '99da560f-01fc-4f4c-81f8-7d3a72dc8d45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:3a:57', 'vm-uuid': '47d20f82-0294-43b9-97a3-7ae8c564d08d'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:48:35 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Deleted allocations for instance c1cdc84b-3fe7-4965-8e2e-9c202d372274
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:48:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:35 user nova-compute[75233]: INFO os_vif [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01')
Dec 05 13:48:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-13f90f6a-f46c-4641-bb16-347500a889b7 tempest-DeleteServersTestJSON-1495418042 tempest-DeleteServersTestJSON-1495418042-project-member] Lock "c1cdc84b-3fe7-4965-8e2e-9c202d372274" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.997s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-89275d00-99f5-431f-a5ac-0cb37e6addca req-1b503d14-e7a1-4c13-86cb-14b32f72089f service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-89275d00-99f5-431f-a5ac-0cb37e6addca req-1b503d14-e7a1-4c13-86cb-14b32f72089f service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-89275d00-99f5-431f-a5ac-0cb37e6addca req-1b503d14-e7a1-4c13-86cb-14b32f72089f service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-89275d00-99f5-431f-a5ac-0cb37e6addca req-1b503d14-e7a1-4c13-86cb-14b32f72089f service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-89275d00-99f5-431f-a5ac-0cb37e6addca req-1b503d14-e7a1-4c13-86cb-14b32f72089f service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:36 user nova-compute[75233]: WARNING nova.compute.manager [req-89275d00-99f5-431f-a5ac-0cb37e6addca req-1b503d14-e7a1-4c13-86cb-14b32f72089f service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state stopped and task_state powering-on.
Dec 05 13:48:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:48:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance rebooted successfully.
Dec 05 13:48:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-4e3e189e-8b15-4a1c-8761-97c41ab1c7b5 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:48:38 user nova-compute[75233]: DEBUG nova.compute.manager [req-1bb3e6a2-5626-4eb1-a514-33e1f534ed41 req-9e537957-f263-4af5-adc1-435c492e4786 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:48:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1bb3e6a2-5626-4eb1-a514-33e1f534ed41 req-9e537957-f263-4af5-adc1-435c492e4786 service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1bb3e6a2-5626-4eb1-a514-33e1f534ed41 req-9e537957-f263-4af5-adc1-435c492e4786 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1bb3e6a2-5626-4eb1-a514-33e1f534ed41 req-9e537957-f263-4af5-adc1-435c492e4786 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:38 user nova-compute[75233]: DEBUG nova.compute.manager [req-1bb3e6a2-5626-4eb1-a514-33e1f534ed41 req-9e537957-f263-4af5-adc1-435c492e4786 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:48:38 user nova-compute[75233]: WARNING nova.compute.manager [req-1bb3e6a2-5626-4eb1-a514-33e1f534ed41 req-9e537957-f263-4af5-adc1-435c492e4786 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state active and task_state None.
Dec 05 13:48:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrOdpoIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:48:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:43 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:48:43 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e76be-b2bb-4863-bcd0-36cff0fa7c53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:48:43 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e2b6b-a633-4064-b3f2-43da24f90b4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827] added
Dec 05 13:48:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0d50b-aab4-46d9-922c-017f4a7ed608]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb5565-3eca-458a-a5ee-0ac582d8e332]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrOdpoIi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrOdpoIi" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d8a97-02ec-45ad-b2d1-8ebf376e3f5a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PrOdpoIi'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f22bc5-d707-411f-b029-d2bbcf64c5cc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58572aac-f34b-47ff-ab0e-3f58b1d7af75]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c41fac-4324-43c8-96ca-e23d79194626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260]
Dec 05 13:48:43 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260] successful.
Dec 05 13:48:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a329f4-0116-4ed0-a23b-f19dc7a4a52d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56f0f5a-506c-4423-a9f7-735efb1bf526]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:48:43 user nova-compute[75233]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 (non-flash)
Dec 05 13:48:43 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[885a261d-8cd0-4443-80a6-1881e6b1708d]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:48:43 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrOdpoIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26265326164613535', 'path': '/dev/sde'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265326164613535', 'path': '/dev/sde'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'flavor' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:48:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:48:44 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:48:44 user nova-compute[75233]:   <source dev="/dev/sde"/>
Dec 05 13:48:44 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 13:48:44 user nova-compute[75233]:   <serial>d16bba44-7e16-4b2e-80e1-94f440989827</serial>
Dec 05 13:48:44 user nova-compute[75233]: </disk>
Dec 05 13:48:44 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] No VIF found with MAC fa:16:3e:b0:f9:be, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77854681-a4ba-495d-8393-eb49cf1212e6 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.195s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:46 user nova-compute[75233]: INFO nova.compute.manager [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Detaching volume d16bba44-7e16-4b2e-80e1-94f440989827
Dec 05 13:48:46 user nova-compute[75233]: INFO nova.virt.block_device [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attempting to driver detach volume d16bba44-7e16-4b2e-80e1-94f440989827 from mountpoint /dev/vdc
Dec 05 13:48:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Attempting to detach device vdc from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:48:46 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:48:46 user nova-compute[75233]:   <source dev="/dev/sde"/>
Dec 05 13:48:46 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 13:48:46 user nova-compute[75233]:   <serial>d16bba44-7e16-4b2e-80e1-94f440989827</serial>
Dec 05 13:48:46 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 13:48:46 user nova-compute[75233]: </disk>
Dec 05 13:48:46 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:48:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Successfully detached device vdc from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the persistent domain config.
Dec 05 13:48:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:48:46 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:48:46 user nova-compute[75233]:   <source dev="/dev/sde"/>
Dec 05 13:48:46 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 13:48:46 user nova-compute[75233]:   <serial>d16bba44-7e16-4b2e-80e1-94f440989827</serial>
Dec 05 13:48:46 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 13:48:46 user nova-compute[75233]: </disk>
Dec 05 13:48:46 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:48:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:50 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:50 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7586MB free_disk=25.08454132080078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Applying migration context for instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 as it has an incoming, in-progress migration 64f171e0-022e-4e32-b34e-968cb42bd031. Migration status is finished {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 13:48:50 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating resource usage from migration 64f171e0-022e-4e32-b34e-968cb42bd031
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 84e303d2-b587-4574-bd33-d682e74289a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b4b42e4d-f5e2-48ec-842a-536a1f250585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Migration 64f171e0-022e-4e32-b34e-968cb42bd031 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 4f0cc131-8133-40a7-b331-6c87051b7646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fba66d11-7258-45dd-9d43-d6243d334d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fc9d177a-43bf-4644-bc62-f7203019d911 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:48:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:48:55 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:48:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:48:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:48:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:49:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing instance network info cache due to event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:49:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:03 user nova-compute[75233]: DEBUG nova.network.neutron [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'flavor' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG nova.network.neutron [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updated VIF entry in instance network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG nova.network.neutron [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0873cbcd-13d1-4169-b9e3-7f295f437fac req-148881bf-36b4-4fe8-85ac-f0bad2844a2f service nova] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:04 user nova-compute[75233]: INFO nova.compute.manager [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Attaching volume 8e519c9a-cc14-47bf-a26a-acc1dae0d966 to /dev/vdb
Dec 05 13:49:04 user nova-compute[75233]: DEBUG os_brick.utils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f006db-ce9b-4319-a585-fda74e30d14c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[59729a8a-eaec-4a1d-b835-c71801020ab4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b00a38-22a7-4baf-9dad-3e3f899bbe1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4b2ef9-c917-4e98-b6af-3301e92679b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:04 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:49:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f4b600-1f71-4ef9-9e4b-1294064a6dcc]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG os_brick.utils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:04 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating existing volume attachment record: 64ff9283-ceaf-4fa5-9ab8-a758ed450af8 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:49:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 84e303d2-b587-4574-bd33-d682e74289a9 is timed out.
Dec 05 13:49:06 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Successfully detached device vdc from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the live domain config.
Dec 05 13:49:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrOdpoIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2edd0f-df65-463e-abb5-911835d70da2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:49:06 user nova-compute[75233]: No targets found.
Dec 05 13:49:06 user nova-compute[75233]: iSNS:
Dec 05 13:49:06 user nova-compute[75233]: No targets found.
Dec 05 13:49:06 user nova-compute[75233]: STATIC:
Dec 05 13:49:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9
Dec 05 13:49:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:49:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:49:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827
Dec 05 13:49:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:06 user nova-compute[75233]: FIRMWARE:
Dec 05 13:49:06 user nova-compute[75233]: No targets found.
Dec 05 13:49:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:49:06 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:49:06 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:49:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd4e3d1-3267-4c5e-a4c0-2fabcbdfa596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4337deec-529b-42cc-be6e-3cc6830b917a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:07 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:07 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:07 user nova-compute[75233]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 (non-flash)
Dec 05 13:49:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:07 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:07 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:07 user nova-compute[75233]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 (non-flash)
Dec 05 13:49:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f346985e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827'): ({'sde'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Removing single pathed devices sde {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46dd4ed-6caf-42aa-a742-d45717dcc965]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9b6b1a-6a2f-4f93-a86f-598642246795]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Flushing IO for device /dev/sde {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[089839fc-d59c-40d4-b435-29798d33ecce]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1082f5ec-4456-4793-9862-d26ef80c2ec7]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad593b3b-db63-4276-952f-30693cc89e9f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71dfd7c-5a61-4cb5-9407-d78e8ed24da9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260]
Dec 05 13:49:07 user nova-compute[75233]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827, portal: 172.16.0.220,3260] successful.
Dec 05 13:49:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16bba44-7e16-4b2e-80e1-94f440989827 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07df5ca-7eae-4d68-b283-a476766f49d8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] <== disconnect_volume: return (303ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:49:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'flavor' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ef7d04f-704b-4253-ad7f-9897f73033f4 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:12 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Port 217ff3c3-5eed-435e-b7b1-ec6872e83d24 binding to destination host user is already ACTIVE {{(pid=75233) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 13:49:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:12 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Creating tmpfile /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/tmphwhtppdi to verify with other compute node that the instance is on the same shared storage. {{(pid=75233) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9630}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-5535d6e6-fea8-4b94-94f4-df1a2bdd9080 req-a4cd18ea-da74-4457-8aef-8302eaaab359 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5535d6e6-fea8-4b94-94f4-df1a2bdd9080 req-a4cd18ea-da74-4457-8aef-8302eaaab359 service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5535d6e6-fea8-4b94-94f4-df1a2bdd9080 req-a4cd18ea-da74-4457-8aef-8302eaaab359 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5535d6e6-fea8-4b94-94f4-df1a2bdd9080 req-a4cd18ea-da74-4457-8aef-8302eaaab359 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-5535d6e6-fea8-4b94-94f4-df1a2bdd9080 req-a4cd18ea-da74-4457-8aef-8302eaaab359 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:13 user nova-compute[75233]: WARNING nova.compute.manager [req-5535d6e6-fea8-4b94-94f4-df1a2bdd9080 req-a4cd18ea-da74-4457-8aef-8302eaaab359 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state resized and task_state resize_reverting.
Dec 05 13:49:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance destroyed successfully.
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.objects.instance [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'resources' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217ff3c3-5e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fa0cf74-c3e2-43e4-be1c-c36b5b0ab4dc) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:13 user nova-compute[75233]: INFO os_vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e')
Dec 05 13:49:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:13 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef94ac0-4eb9-49af-b655-2923199e6afe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:49:13 user nova-compute[75233]: No targets found.
Dec 05 13:49:13 user nova-compute[75233]: iSNS:
Dec 05 13:49:13 user nova-compute[75233]: No targets found.
Dec 05 13:49:13 user nova-compute[75233]: STATIC:
Dec 05 13:49:13 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9
Dec 05 13:49:13 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:13 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:13 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:49:13 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:13 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:13 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:49:13 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:13 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:13 user nova-compute[75233]: FIRMWARE:
Dec 05 13:49:13 user nova-compute[75233]: No targets found.
Dec 05 13:49:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:49:13 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:49:13 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f8cb1-b556-42a1-b81a-e3246f14b2ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3cceef-830b-456c-8ec7-b55e3713a8b8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:13 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:13 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:13 user nova-compute[75233]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:13 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f347427a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65326fe-c6bd-40b5-bac3-788607e7de7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca082e-d4d8-4b53-9eba-20aff56acf0e]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99071b2-1c3d-445f-90c9-79e45df51cdf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc0367-8d67-4ac8-a55a-679f01176124]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:49:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c8a32-198b-40f8-97ac-b6ed79a5b296]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwZtCiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:14 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f3fea9-5e9c-4bf0-aa70-748200c605d3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]
Dec 05 13:49:14 user nova-compute[75233]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840306b-cf35-44f3-9a88-f6f1779254a1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== disconnect_volume: return (306ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.094s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:14 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:14 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e2b48-804f-4002-b0c3-5b5cb81463ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:49:14 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8491ddbf-ff9e-42f9-9a3d-8dd97025cb04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966] added
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b838c54-c512-41ce-a6e7-ee28a0697b50]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf133d8a-9c60-465e-9e0e-0c257311e472]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwZtCiKx {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwZtCiKx" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea6d4cf-36ce-40ae-934f-c87cab035574]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uwZtCiKx'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a0f5a-3dda-4037-9340-62ca8801ab98]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c3ddc-9bb9-46b3-b95a-34b557db2326]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:14 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:14 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7f32e2-f64b-4ca7-9668-708bd04a756c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260]
Dec 05 13:49:14 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260] successful.
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ba523-5a70-4802-ae46-8e09a6af8751]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce59d4-aeba-4c9c-8cac-e0aeedb882be]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:14 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:14 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:14 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:14 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de844bb-58f8-4f5c-a5a3-dd821b37f344]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:49:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwZtCiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.objects.instance [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'migration_context' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.objects.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Object Instance<ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2> lazy-loaded attributes: resources,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-187d0b05-3f32-460c-a812-edf9ffbdf996 req-1e103e1a-7b9d-4a92-9209-78f18c9a8e6d service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-187d0b05-3f32-460c-a812-edf9ffbdf996 req-1e103e1a-7b9d-4a92-9209-78f18c9a8e6d service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-187d0b05-3f32-460c-a812-edf9ffbdf996 req-1e103e1a-7b9d-4a92-9209-78f18c9a8e6d service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-187d0b05-3f32-460c-a812-edf9ffbdf996 req-1e103e1a-7b9d-4a92-9209-78f18c9a8e6d service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-187d0b05-3f32-460c-a812-edf9ffbdf996 req-1e103e1a-7b9d-4a92-9209-78f18c9a8e6d service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:15 user nova-compute[75233]: WARNING nova.compute.manager [req-187d0b05-3f32-460c-a812-edf9ffbdf996 req-1e103e1a-7b9d-4a92-9209-78f18c9a8e6d service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state resized and task_state resize_reverting.
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23735356365333466', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735356365333466', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.objects.instance [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'flavor' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:49:15 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:49:15 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:49:15 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:49:15 user nova-compute[75233]:   <serial>8e519c9a-cc14-47bf-a26a-acc1dae0d966</serial>
Dec 05 13:49:15 user nova-compute[75233]: </disk>
Dec 05 13:49:15 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.423s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:15 user nova-compute[75233]: INFO nova.compute.manager [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Swapping old allocation on dict_keys(['fdab8c34-39de-4e1a-b763-0eb01d8e8585']) held by migration 64f171e0-022e-4e32-b34e-968cb42bd031 for instance
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Overwriting current allocation {'allocations': {'fdab8c34-39de-4e1a-b763-0eb01d8e8585': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 28}}, 'project_id': '434c6a79034f4bb79f70faf8c468504e', 'user_id': 'f607b8d442c740fe865f6b96b6dcdcbd', 'consumer_generation': 1} on consumer ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:9f:2a:f2, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be169b2b-5f6b-4ec0-a96b-696385469875 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.540s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG os_brick.utils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d40f1-7619-4d48-9800-e62e89c0034b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d87b5a8-5e27-49d7-9e70-8ac79fa2a3a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[65889caf-6a22-46cd-a220-18cd90394467]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d8c04b-1078-4664-b2ca-1b3d01be2c93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:16 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e816e-0348-4489-8c7e-f89bf958b70f]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG os_brick.utils [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:16 user nova-compute[75233]: INFO nova.compute.manager [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Rescuing
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-changed-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Refreshing instance network info cache due to event network-changed-6009ab44-d20d-46bc-9847-842362dc8fe2. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] Acquiring lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] Acquired lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Refreshing network info cache for port 6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-4eb2ab9d-94a8-4d55-86e6-65de0a17b086 req-f0921bd0-968c-4e49-9a73-042119c3f94f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4eb2ab9d-94a8-4d55-86e6-65de0a17b086 req-f0921bd0-968c-4e49-9a73-042119c3f94f service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4eb2ab9d-94a8-4d55-86e6-65de0a17b086 req-f0921bd0-968c-4e49-9a73-042119c3f94f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4eb2ab9d-94a8-4d55-86e6-65de0a17b086 req-f0921bd0-968c-4e49-9a73-042119c3f94f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-4eb2ab9d-94a8-4d55-86e6-65de0a17b086 req-f0921bd0-968c-4e49-9a73-042119c3f94f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:17 user nova-compute[75233]: WARNING nova.compute.manager [req-4eb2ab9d-94a8-4d55-86e6-65de0a17b086 req-f0921bd0-968c-4e49-9a73-042119c3f94f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updated VIF entry in instance network info cache for port 6009ab44-d20d-46bc-9847-842362dc8fe2. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updating instance_info_cache with network_info: [{"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c82e1d4b-fb87-4cba-b2b8-0e06edf6afd1 req-b4a73fa1-738d-4437-939b-13eb604e3985 service nova] Releasing lock "refresh_cache-4f0cc131-8133-40a7-b331-6c87051b7646" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance destroyed successfully.
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Attempting rescue
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:49:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Creating image(s)
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'trusted_certs' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue" returned: 0 in 0.061s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'migration_context' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<b4b42e4d-f5e2-48ec-842a-536a1f250585> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Start _get_guest_xml network_info=[{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:9f:2a:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'resources' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<b4b42e4d-f5e2-48ec-842a-536a1f250585> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'numa_topology' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<b4b42e4d-f5e2-48ec-842a-536a1f250585> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid 4f0cc131-8133-40a7-b331-6c87051b7646 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:18 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<b4b42e4d-f5e2-48ec-842a-536a1f250585> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-680434618',display_name='tempest-ServerRescueNegativeTestJSON-server-680434618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-680434618',id=21,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpccRe6hIADiJ7Et68v/LZB0pXu1DVkRqKIgjrV5HlRSbTkySUEcjRhIMF4tGXTsUKj9ERGLozGck76J7eTzgkALmXLWlmj4hy7CLqM5BYmPrSkCZzMJpLz8466cLaacg==',key_name='tempest-keypair-1531648438',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:47:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1gvknz6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=b4b42e4d-f5e2-48ec-842a-536a1f250585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:9f:2a:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "vif_mac": "fa:16:3e:9f:2a:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'pci_devices' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Object Instance<b4b42e4d-f5e2-48ec-842a-536a1f250585> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:49:18 user nova-compute[75233]:   <uuid>b4b42e4d-f5e2-48ec-842a-536a1f250585</uuid>
Dec 05 13:49:18 user nova-compute[75233]:   <name>instance-00000015</name>
Dec 05 13:49:18 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:49:18 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:49:18 user nova-compute[75233]:   <metadata>
Dec 05 13:49:18 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:49:18 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:49:18 user nova-compute[75233]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-680434618</nova:name>
Dec 05 13:49:18 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:49:18</nova:creationTime>
Dec 05 13:49:18 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:49:18 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:49:18 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:49:18 user nova-compute[75233]:       <nova:owner>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:user uuid="e7ddf7a828a547e9b606ed9e8e8727eb">tempest-ServerRescueNegativeTestJSON-2142653953-project-member</nova:user>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:project uuid="16b7c3d1e9a7462b8c4833174777873e">tempest-ServerRescueNegativeTestJSON-2142653953</nova:project>
Dec 05 13:49:18 user nova-compute[75233]:       </nova:owner>
Dec 05 13:49:18 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:49:18 user nova-compute[75233]:       <nova:ports>
Dec 05 13:49:18 user nova-compute[75233]:         <nova:port uuid="1405dadf-e129-4a04-b5e2-ef49395ebcdd">
Dec 05 13:49:18 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:49:18 user nova-compute[75233]:         </nova:port>
Dec 05 13:49:18 user nova-compute[75233]:       </nova:ports>
Dec 05 13:49:18 user nova-compute[75233]:     </nova:instance>
Dec 05 13:49:18 user nova-compute[75233]:   </metadata>
Dec 05 13:49:18 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:49:18 user nova-compute[75233]:     <system>
Dec 05 13:49:18 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:49:18 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:49:18 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:49:18 user nova-compute[75233]:       <entry name="serial">b4b42e4d-f5e2-48ec-842a-536a1f250585</entry>
Dec 05 13:49:18 user nova-compute[75233]:       <entry name="uuid">b4b42e4d-f5e2-48ec-842a-536a1f250585</entry>
Dec 05 13:49:18 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:49:18 user nova-compute[75233]:     </system>
Dec 05 13:49:18 user nova-compute[75233]:   </sysinfo>
Dec 05 13:49:18 user nova-compute[75233]:   <os>
Dec 05 13:49:18 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:49:18 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:49:18 user nova-compute[75233]:   </os>
Dec 05 13:49:18 user nova-compute[75233]:   <features>
Dec 05 13:49:18 user nova-compute[75233]:     <acpi/>
Dec 05 13:49:18 user nova-compute[75233]:     <apic/>
Dec 05 13:49:18 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:49:18 user nova-compute[75233]:   </features>
Dec 05 13:49:18 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:49:18 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:49:18 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:49:18 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:49:18 user nova-compute[75233]:   </clock>
Dec 05 13:49:18 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:49:18 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:49:18 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:49:18 user nova-compute[75233]:   </cpu>
Dec 05 13:49:18 user nova-compute[75233]:   <devices>
Dec 05 13:49:18 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:49:18 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:49:18 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue"/>
Dec 05 13:49:18 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:49:18 user nova-compute[75233]:     </disk>
Dec 05 13:49:18 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:49:18 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:49:18 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk"/>
Dec 05 13:49:18 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:49:18 user nova-compute[75233]:     </disk>
Dec 05 13:49:18 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:49:18 user nova-compute[75233]:       <mac address="fa:16:3e:9f:2a:f2"/>
Dec 05 13:49:18 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:18 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:49:18 user nova-compute[75233]:       <target dev="tap1405dadf-e1"/>
Dec 05 13:49:18 user nova-compute[75233]:     </interface>
Dec 05 13:49:18 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:49:18 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/console.log" append="off"/>
Dec 05 13:49:18 user nova-compute[75233]:     </serial>
Dec 05 13:49:18 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:49:18 user nova-compute[75233]:     <video>
Dec 05 13:49:18 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:18 user nova-compute[75233]:     </video>
Dec 05 13:49:18 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:49:18 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:49:18 user nova-compute[75233]:     </rng>
Dec 05 13:49:18 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:49:18 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:49:18 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:49:18 user nova-compute[75233]:     </memballoon>
Dec 05 13:49:18 user nova-compute[75233]:   </devices>
Dec 05 13:49:18 user nova-compute[75233]: </domain>
Dec 05 13:49:18 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance destroyed successfully.
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] No VIF found with MAC fa:16:3e:9f:2a:f2, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:18 user nova-compute[75233]: INFO nova.compute.manager [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Attaching volume 4152b2ea-a333-4d73-9fc1-81193949ecbe to /dev/vdb
Dec 05 13:49:18 user nova-compute[75233]: DEBUG os_brick.utils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deacc72-0be2-43be-bcb2-773054a652d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18b8b2a-b0f8-4574-9e36-e17b3c7e410b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48b774-b7f6-48ec-8a21-d4cc168700ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d378f1dc-c1ac-4a96-9682-257f95d15667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:18 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:49:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ff0d1-729f-416f-9286-6b1c99f671e4]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG os_brick.utils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:18 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updating existing volume attachment record: cfb1ccc0-798c-4366-920e-757498781d75 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:19 user nova-compute[75233]: WARNING nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:19 user nova-compute[75233]: WARNING nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:19 user nova-compute[75233]: WARNING nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:19 user nova-compute[75233]: WARNING nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:19 user nova-compute[75233]: WARNING nova.compute.manager [req-a145172c-500f-4330-8011-a14282a0e24b req-ee85cb19-ae57-4319-8ae0-6009211cc987 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:21 user nova-compute[75233]: WARNING nova.compute.manager [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:21 user nova-compute[75233]: WARNING nova.compute.manager [req-adfe5288-c1e9-424f-bd69-0dbb0ef212cb req-e2b0b6c3-590a-446e-a43d-59e8f97e4bda service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state active and task_state rescuing.
Dec 05 13:49:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e65a3258-7f87-4945-9ff9-d6ac38b33e15 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:49:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Starting finish_revert_migration {{(pid=75233) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11822}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start _get_guest_xml network_info=[{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2', 'attached_at': '2023-12-05T13:49:27.000000', 'detached_at': '', 'volume_id': 'c98a70fc-f8bf-435c-804e-54bafb5cf870', 'serial': 'c98a70fc-f8bf-435c-804e-54bafb5cf870'}, 'delete_on_termination': False, 'attachment_id': '0089e098-c09b-42f8-8408-9a3fc06175f7', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:49:27 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:27 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:27 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb3abf-7855-4d29-9980-ac88424d513f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:49:27 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[beed8f77-e2db-4087-83d2-e0afc418bf56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870] added
Dec 05 13:49:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[702a4b79-dd4c-422d-be1c-849ad7e9f736]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8bcd6a-0176-487e-9452-edfe821f9fac]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBVwOcqW {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBVwOcqW" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd61ad-2f08-4184-87e9-4d43b7351edc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBVwOcqW'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b27eceb-9b02-48f0-9823-ca47433266d2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a545271-479d-4d8b-83ae-11480995a5c9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd4ba5-3a5f-4942-92da-3cbae14d2e7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]
Dec 05 13:49:27 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.
Dec 05 13:49:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e97d95-ddd9-48b8-a49e-2f4b96fb365f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98deffb9-1ab0-43ab-b429-022f7fccd929]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a4596-e420-438c-91f5-6f6f04ccb873]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26539343962653831', 'path': '/dev/sde'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539343962653831', 'path': '/dev/sde'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:49:28 user nova-compute[75233]:   <uuid>ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</uuid>
Dec 05 13:49:28 user nova-compute[75233]:   <name>instance-0000000f</name>
Dec 05 13:49:28 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:49:28 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:49:28 user nova-compute[75233]:   <metadata>
Dec 05 13:49:28 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:49:28 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:49:28 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherB-server-1529541965</nova:name>
Dec 05 13:49:28 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:49:27</nova:creationTime>
Dec 05 13:49:28 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:49:28 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:49:28 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:49:28 user nova-compute[75233]:       <nova:owner>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:user uuid="f607b8d442c740fe865f6b96b6dcdcbd">tempest-ServerActionsTestOtherB-963894040-project-member</nova:user>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:project uuid="434c6a79034f4bb79f70faf8c468504e">tempest-ServerActionsTestOtherB-963894040</nova:project>
Dec 05 13:49:28 user nova-compute[75233]:       </nova:owner>
Dec 05 13:49:28 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:49:28 user nova-compute[75233]:       <nova:ports>
Dec 05 13:49:28 user nova-compute[75233]:         <nova:port uuid="217ff3c3-5eed-435e-b7b1-ec6872e83d24">
Dec 05 13:49:28 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:49:28 user nova-compute[75233]:         </nova:port>
Dec 05 13:49:28 user nova-compute[75233]:       </nova:ports>
Dec 05 13:49:28 user nova-compute[75233]:     </nova:instance>
Dec 05 13:49:28 user nova-compute[75233]:   </metadata>
Dec 05 13:49:28 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:49:28 user nova-compute[75233]:     <system>
Dec 05 13:49:28 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:49:28 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:49:28 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:49:28 user nova-compute[75233]:       <entry name="serial">ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</entry>
Dec 05 13:49:28 user nova-compute[75233]:       <entry name="uuid">ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2</entry>
Dec 05 13:49:28 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:49:28 user nova-compute[75233]:     </system>
Dec 05 13:49:28 user nova-compute[75233]:   </sysinfo>
Dec 05 13:49:28 user nova-compute[75233]:   <os>
Dec 05 13:49:28 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:49:28 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:49:28 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:49:28 user nova-compute[75233]:   </os>
Dec 05 13:49:28 user nova-compute[75233]:   <features>
Dec 05 13:49:28 user nova-compute[75233]:     <acpi/>
Dec 05 13:49:28 user nova-compute[75233]:     <apic/>
Dec 05 13:49:28 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:49:28 user nova-compute[75233]:   </features>
Dec 05 13:49:28 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:49:28 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:49:28 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:49:28 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:49:28 user nova-compute[75233]:   </clock>
Dec 05 13:49:28 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:49:28 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:49:28 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:49:28 user nova-compute[75233]:   </cpu>
Dec 05 13:49:28 user nova-compute[75233]:   <devices>
Dec 05 13:49:28 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:49:28 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:49:28 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk"/>
Dec 05 13:49:28 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:49:28 user nova-compute[75233]:     </disk>
Dec 05 13:49:28 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:49:28 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:49:28 user nova-compute[75233]:       <source dev="/dev/sde"/>
Dec 05 13:49:28 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:49:28 user nova-compute[75233]:       <serial>c98a70fc-f8bf-435c-804e-54bafb5cf870</serial>
Dec 05 13:49:28 user nova-compute[75233]:     </disk>
Dec 05 13:49:28 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:49:28 user nova-compute[75233]:       <mac address="fa:16:3e:84:db:58"/>
Dec 05 13:49:28 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:28 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:49:28 user nova-compute[75233]:       <target dev="tap217ff3c3-5e"/>
Dec 05 13:49:28 user nova-compute[75233]:     </interface>
Dec 05 13:49:28 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:49:28 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/console.log" append="off"/>
Dec 05 13:49:28 user nova-compute[75233]:     </serial>
Dec 05 13:49:28 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:49:28 user nova-compute[75233]:     <video>
Dec 05 13:49:28 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:28 user nova-compute[75233]:     </video>
Dec 05 13:49:28 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:49:28 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:49:28 user nova-compute[75233]:     </rng>
Dec 05 13:49:28 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:49:28 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:49:28 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:49:28 user nova-compute[75233]:     </memballoon>
Dec 05 13:49:28 user nova-compute[75233]:   </devices>
Dec 05 13:49:28 user nova-compute[75233]: </domain>
Dec 05 13:49:28 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG os_vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36de330a-e990-515a-a496-2ad64990ee81', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217ff3c3-5e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap217ff3c3-5e, col_values=(('qos', UUID('19afd95e-1946-481f-91e4-42f9219625ab')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap217ff3c3-5e, col_values=(('external_ids', {'iface-id': '217ff3c3-5eed-435e-b7b1-ec6872e83d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:db:58', 'vm-uuid': 'ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:49:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:28 user nova-compute[75233]: INFO os_vif [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e')
Dec 05 13:49:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBhcJVYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:29 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:29 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:29 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dcdafc-6cdf-4f2f-8e2d-4165fded18d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:49:29 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b203873-c6fd-43db-99fd-c8c1c34d7ff1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe] added
Dec 05 13:49:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09ee57-576d-482d-9ffe-cef7544fbf58]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bb1d76-ad5b-4a83-a6b3-ebe845ca104d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBhcJVYv {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aBhcJVYv" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[586bb556-2927-4323-be83-725cb7d80363]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aBhcJVYv'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b955e1-40bb-4e22-867d-70ee2a5895c2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3eda2b-8392-4cad-b582-c12144437561]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09d486-0478-443b-b5d5-65005738ccd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260]
Dec 05 13:49:29 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260] successful.
Dec 05 13:49:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c48df32-bd4a-4b11-af5e-6160a4f4be7e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66db5eb-925d-4eb9-94db-b74f97320580]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:49:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:29 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:49:29 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd066661-b91a-470f-a2d8-7ee7a320294b]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:49:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBhcJVYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-10b68eac-a238-494e-8b22-88f59b82fdba req-dc3d3e3a-f162-4e23-a65c-80afe178c881 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-10b68eac-a238-494e-8b22-88f59b82fdba req-dc3d3e3a-f162-4e23-a65c-80afe178c881 service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-10b68eac-a238-494e-8b22-88f59b82fdba req-dc3d3e3a-f162-4e23-a65c-80afe178c881 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-10b68eac-a238-494e-8b22-88f59b82fdba req-dc3d3e3a-f162-4e23-a65c-80afe178c881 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-10b68eac-a238-494e-8b22-88f59b82fdba req-dc3d3e3a-f162-4e23-a65c-80afe178c881 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:30 user nova-compute[75233]: WARNING nova.compute.manager [req-10b68eac-a238-494e-8b22-88f59b82fdba req-dc3d3e3a-f162-4e23-a65c-80afe178c881 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state resized and task_state resize_reverting.
Dec 05 13:49:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23531303666386635', 'path': '/dev/sdf'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531303666386635', 'path': '/dev/sdf'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid 4f0cc131-8133-40a7-b331-6c87051b7646 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:49:30 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:49:30 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:49:30 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:49:30 user nova-compute[75233]:   <serial>4152b2ea-a333-4d73-9fc1-81193949ecbe</serial>
Dec 05 13:49:30 user nova-compute[75233]: </disk>
Dec 05 13:49:30 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:e9:f0:34, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:49:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7ebc39a5-2e82-4c3a-92cf-c2aa92a03d71 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.422s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:49:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance running successfully.
Dec 05 13:49:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] finish_revert_migration finished successfully. {{(pid=75233) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11866}}
Dec 05 13:49:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-9946b053-7373-4772-b78e-01d4e1d6501e req-40f41a7b-128f-4204-b7a8-768aec50ccd2 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9946b053-7373-4772-b78e-01d4e1d6501e req-40f41a7b-128f-4204-b7a8-768aec50ccd2 service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9946b053-7373-4772-b78e-01d4e1d6501e req-40f41a7b-128f-4204-b7a8-768aec50ccd2 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9946b053-7373-4772-b78e-01d4e1d6501e req-40f41a7b-128f-4204-b7a8-768aec50ccd2 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-9946b053-7373-4772-b78e-01d4e1d6501e req-40f41a7b-128f-4204-b7a8-768aec50ccd2 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:32 user nova-compute[75233]: WARNING nova.compute.manager [req-9946b053-7373-4772-b78e-01d4e1d6501e req-40f41a7b-128f-4204-b7a8-768aec50ccd2 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state resized and task_state resize_reverting.
Dec 05 13:49:32 user nova-compute[75233]: INFO nova.compute.manager [None req-bf9b0b4f-9dd3-47fb-81b0-829578685bfd tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance to original state: 'active'
Dec 05 13:49:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:35 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:49:35 user nova-compute[75233]: INFO nova.compute.claims [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Claim successful on node user
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:49:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.policy [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebeefb2fa465406b911b62137057223a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a22149826499ba7d03f47ce7375cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:49:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Creating image(s)
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.203s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:36 user nova-compute[75233]: INFO nova.compute.manager [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Detaching volume 6220ccb4-1144-4c73-a00b-4915ad5a2bf9
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.217s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:37 user nova-compute[75233]: INFO nova.virt.block_device [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Attempting to driver detach volume 6220ccb4-1144-4c73-a00b-4915ad5a2bf9 from mountpoint /dev/vdb
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk 1073741824" returned: 0 in 0.052s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Attempting to detach device vdb from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:49:37 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:49:37 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:49:37 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:49:37 user nova-compute[75233]:   <serial>6220ccb4-1144-4c73-a00b-4915ad5a2bf9</serial>
Dec 05 13:49:37 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:49:37 user nova-compute[75233]: </disk>
Dec 05 13:49:37 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:49:37 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Successfully detached device vdb from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the persistent domain config.
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:49:37 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:49:37 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:49:37 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:49:37 user nova-compute[75233]:   <serial>6220ccb4-1144-4c73-a00b-4915ad5a2bf9</serial>
Dec 05 13:49:37 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:49:37 user nova-compute[75233]: </disk>
Dec 05 13:49:37 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Cannot resize image /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Ensure instance console log exists: /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 13:49:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Successfully created port: 1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:49:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Successfully updated port: 1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquired lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-changed-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Refreshing instance network info cache due to event network-changed-1cd02156-50ed-4f0d-841e-410bd36fcaae. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] Acquiring lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Updating instance_info_cache with network_info: [{"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Releasing lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Instance network_info: |[{"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] Acquired lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Refreshing network info cache for port 1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Start _get_guest_xml network_info=[{"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:49:39 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:39 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-652643745',display_name='tempest-AttachVolumeNegativeTest-server-652643745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-652643745',id=25,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVaAahQ9monX/qem4Xa74MHDMsUdMu3fk2VW2XJs1VTWh6WHY0XiCpYiW2RKw6gJwidqJkiHaw6n0kQIaMYROjuIkDBjj+Q8i7leYh3Gr/tVQ8ufrsh/S+KUGxG+OSjQg==',key_name='tempest-keypair-1164170049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-vnb77fu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=5f8c968a-c8fb-4399-8c0d-4fa208739ada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f8c968a-c8fb-4399-8c0d-4fa208739ada {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:49:39 user nova-compute[75233]:   <uuid>5f8c968a-c8fb-4399-8c0d-4fa208739ada</uuid>
Dec 05 13:49:39 user nova-compute[75233]:   <name>instance-00000019</name>
Dec 05 13:49:39 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:49:39 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:49:39 user nova-compute[75233]:   <metadata>
Dec 05 13:49:39 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:49:39 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:49:39 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-652643745</nova:name>
Dec 05 13:49:39 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:49:39</nova:creationTime>
Dec 05 13:49:39 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:49:39 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:49:39 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:49:39 user nova-compute[75233]:       <nova:owner>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:user uuid="ebeefb2fa465406b911b62137057223a">tempest-AttachVolumeNegativeTest-525245035-project-member</nova:user>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:project uuid="f73a22149826499ba7d03f47ce7375cd">tempest-AttachVolumeNegativeTest-525245035</nova:project>
Dec 05 13:49:39 user nova-compute[75233]:       </nova:owner>
Dec 05 13:49:39 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:49:39 user nova-compute[75233]:       <nova:ports>
Dec 05 13:49:39 user nova-compute[75233]:         <nova:port uuid="1cd02156-50ed-4f0d-841e-410bd36fcaae">
Dec 05 13:49:39 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 13:49:39 user nova-compute[75233]:         </nova:port>
Dec 05 13:49:39 user nova-compute[75233]:       </nova:ports>
Dec 05 13:49:39 user nova-compute[75233]:     </nova:instance>
Dec 05 13:49:39 user nova-compute[75233]:   </metadata>
Dec 05 13:49:39 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:49:39 user nova-compute[75233]:     <system>
Dec 05 13:49:39 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:49:39 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:49:39 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:49:39 user nova-compute[75233]:       <entry name="serial">5f8c968a-c8fb-4399-8c0d-4fa208739ada</entry>
Dec 05 13:49:39 user nova-compute[75233]:       <entry name="uuid">5f8c968a-c8fb-4399-8c0d-4fa208739ada</entry>
Dec 05 13:49:39 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:49:39 user nova-compute[75233]:     </system>
Dec 05 13:49:39 user nova-compute[75233]:   </sysinfo>
Dec 05 13:49:39 user nova-compute[75233]:   <os>
Dec 05 13:49:39 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:49:39 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:49:39 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:49:39 user nova-compute[75233]:   </os>
Dec 05 13:49:39 user nova-compute[75233]:   <features>
Dec 05 13:49:39 user nova-compute[75233]:     <acpi/>
Dec 05 13:49:39 user nova-compute[75233]:     <apic/>
Dec 05 13:49:39 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:49:39 user nova-compute[75233]:   </features>
Dec 05 13:49:39 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:49:39 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:49:39 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:49:39 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:49:39 user nova-compute[75233]:   </clock>
Dec 05 13:49:39 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:49:39 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:49:39 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:49:39 user nova-compute[75233]:   </cpu>
Dec 05 13:49:39 user nova-compute[75233]:   <devices>
Dec 05 13:49:39 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:49:39 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:49:39 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk"/>
Dec 05 13:49:39 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:49:39 user nova-compute[75233]:     </disk>
Dec 05 13:49:39 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:49:39 user nova-compute[75233]:       <mac address="fa:16:3e:41:4e:cb"/>
Dec 05 13:49:39 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:39 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:49:39 user nova-compute[75233]:       <target dev="tap1cd02156-50"/>
Dec 05 13:49:39 user nova-compute[75233]:     </interface>
Dec 05 13:49:39 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:49:39 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/console.log" append="off"/>
Dec 05 13:49:39 user nova-compute[75233]:     </serial>
Dec 05 13:49:39 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:49:39 user nova-compute[75233]:     <video>
Dec 05 13:49:39 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:39 user nova-compute[75233]:     </video>
Dec 05 13:49:39 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:49:39 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:49:39 user nova-compute[75233]:     </rng>
Dec 05 13:49:39 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:49:39 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:49:39 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:49:39 user nova-compute[75233]:     </memballoon>
Dec 05 13:49:39 user nova-compute[75233]:   </devices>
Dec 05 13:49:39 user nova-compute[75233]: </domain>
Dec 05 13:49:39 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-652643745',display_name='tempest-AttachVolumeNegativeTest-server-652643745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-652643745',id=25,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVaAahQ9monX/qem4Xa74MHDMsUdMu3fk2VW2XJs1VTWh6WHY0XiCpYiW2RKw6gJwidqJkiHaw6n0kQIaMYROjuIkDBjj+Q8i7leYh3Gr/tVQ8ufrsh/S+KUGxG+OSjQg==',key_name='tempest-keypair-1164170049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-vnb77fu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=5f8c968a-c8fb-4399-8c0d-4fa208739ada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG os_vif [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beb304d6-1c36-53bd-a15a-567553ea2a17', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cd02156-50, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cd02156-50, col_values=(('qos', UUID('4d00db36-3d16-4b5c-945b-f318689923eb')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cd02156-50, col_values=(('external_ids', {'iface-id': '1cd02156-50ed-4f0d-841e-410bd36fcaae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:4e:cb', 'vm-uuid': '5f8c968a-c8fb-4399-8c0d-4fa208739ada'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:39 user nova-compute[75233]: INFO os_vif [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50')
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:41:4e:cb, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Updated VIF entry in instance network info cache for port 1cd02156-50ed-4f0d-841e-410bd36fcaae. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Updating instance_info_cache with network_info: [{"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-61c75170-4a3e-4421-bdef-d89f4b7e8ff3 req-993b842f-9cb7-410f-ab07-45b916121342 service nova] Releasing lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:49:40 user nova-compute[75233]: INFO nova.compute.claims [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Claim successful on node user
Dec 05 13:49:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:49:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.policy [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df61cbca359144e4a0c9ce81b51ebcee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd04a994cbca48239afebd5080f31725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:49:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Creating image(s)
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Successfully created port: 0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk 1073741824" returned: 0 in 0.077s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:49:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Cannot resize image /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Ensure instance console log exists: /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Successfully updated port: 0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-changed-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Refreshing instance network info cache due to event network-changed-0e06e2d2-db8d-4e7d-beb9-949b595cc673. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] Acquiring lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Instance network_info: |[{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] Acquired lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Refreshing network info cache for port 0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Start _get_guest_xml network_info=[{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:49:42 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:42 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-617403913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-617403913',id=26,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-217t2rr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:49:41Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=3f5b5067-5f96-48a8-a6da-7630b1a972d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f5b5067-5f96-48a8-a6da-7630b1a972d6 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:49:42 user nova-compute[75233]:   <uuid>3f5b5067-5f96-48a8-a6da-7630b1a972d6</uuid>
Dec 05 13:49:42 user nova-compute[75233]:   <name>instance-0000001a</name>
Dec 05 13:49:42 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:49:42 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:49:42 user nova-compute[75233]:   <metadata>
Dec 05 13:49:42 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:49:42 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:49:42 user nova-compute[75233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-617403913</nova:name>
Dec 05 13:49:42 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:49:42</nova:creationTime>
Dec 05 13:49:42 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:49:42 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:49:42 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:49:42 user nova-compute[75233]:       <nova:owner>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:user uuid="df61cbca359144e4a0c9ce81b51ebcee">tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member</nova:user>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:project uuid="bd04a994cbca48239afebd5080f31725">tempest-ServerBootFromVolumeStableRescueTest-264323439</nova:project>
Dec 05 13:49:42 user nova-compute[75233]:       </nova:owner>
Dec 05 13:49:42 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:49:42 user nova-compute[75233]:       <nova:ports>
Dec 05 13:49:42 user nova-compute[75233]:         <nova:port uuid="0e06e2d2-db8d-4e7d-beb9-949b595cc673">
Dec 05 13:49:42 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 13:49:42 user nova-compute[75233]:         </nova:port>
Dec 05 13:49:42 user nova-compute[75233]:       </nova:ports>
Dec 05 13:49:42 user nova-compute[75233]:     </nova:instance>
Dec 05 13:49:42 user nova-compute[75233]:   </metadata>
Dec 05 13:49:42 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:49:42 user nova-compute[75233]:     <system>
Dec 05 13:49:42 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:49:42 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:49:42 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:49:42 user nova-compute[75233]:       <entry name="serial">3f5b5067-5f96-48a8-a6da-7630b1a972d6</entry>
Dec 05 13:49:42 user nova-compute[75233]:       <entry name="uuid">3f5b5067-5f96-48a8-a6da-7630b1a972d6</entry>
Dec 05 13:49:42 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:49:42 user nova-compute[75233]:     </system>
Dec 05 13:49:42 user nova-compute[75233]:   </sysinfo>
Dec 05 13:49:42 user nova-compute[75233]:   <os>
Dec 05 13:49:42 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:49:42 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:49:42 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:49:42 user nova-compute[75233]:   </os>
Dec 05 13:49:42 user nova-compute[75233]:   <features>
Dec 05 13:49:42 user nova-compute[75233]:     <acpi/>
Dec 05 13:49:42 user nova-compute[75233]:     <apic/>
Dec 05 13:49:42 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:49:42 user nova-compute[75233]:   </features>
Dec 05 13:49:42 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:49:42 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:49:42 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:49:42 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:49:42 user nova-compute[75233]:   </clock>
Dec 05 13:49:42 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:49:42 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:49:42 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:49:42 user nova-compute[75233]:   </cpu>
Dec 05 13:49:42 user nova-compute[75233]:   <devices>
Dec 05 13:49:42 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:49:42 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:49:42 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk"/>
Dec 05 13:49:42 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:49:42 user nova-compute[75233]:     </disk>
Dec 05 13:49:42 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:49:42 user nova-compute[75233]:       <mac address="fa:16:3e:40:ee:73"/>
Dec 05 13:49:42 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:42 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:49:42 user nova-compute[75233]:       <target dev="tap0e06e2d2-db"/>
Dec 05 13:49:42 user nova-compute[75233]:     </interface>
Dec 05 13:49:42 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:49:42 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/console.log" append="off"/>
Dec 05 13:49:42 user nova-compute[75233]:     </serial>
Dec 05 13:49:42 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:49:42 user nova-compute[75233]:     <video>
Dec 05 13:49:42 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:49:42 user nova-compute[75233]:     </video>
Dec 05 13:49:42 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:49:42 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:49:42 user nova-compute[75233]:     </rng>
Dec 05 13:49:42 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:49:42 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:49:42 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:49:42 user nova-compute[75233]:     </memballoon>
Dec 05 13:49:42 user nova-compute[75233]:   </devices>
Dec 05 13:49:42 user nova-compute[75233]: </domain>
Dec 05 13:49:42 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-617403913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-617403913',id=26,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-217t2rr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:49:41Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=3f5b5067-5f96-48a8-a6da-7630b1a972d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG os_vif [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be7783e2-042c-54cc-91b0-55ff273e7b6b', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e06e2d2-db, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e06e2d2-db, col_values=(('qos', UUID('74a29e3d-1012-4b16-8388-6419fe325dd8')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e06e2d2-db, col_values=(('external_ids', {'iface-id': '0e06e2d2-db8d-4e7d-beb9-949b595cc673', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:ee:73', 'vm-uuid': '3f5b5067-5f96-48a8-a6da-7630b1a972d6'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:42 user nova-compute[75233]: INFO os_vif [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db')
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No VIF found with MAC fa:16:3e:40:ee:73, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:49:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Instance spawned successfully.
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:42 user nova-compute[75233]: INFO nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Took 6.42 seconds to spawn the instance on the hypervisor.
Dec 05 13:49:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:49:43 user nova-compute[75233]: INFO nova.compute.manager [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Took 7.35 seconds to build instance.
Dec 05 13:49:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updated VIF entry in instance network info cache for port 0e06e2d2-db8d-4e7d-beb9-949b595cc673. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:49:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ec20158c-5161-4fcb-a16b-b133859f233b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.505s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cc31df31-603d-49e1-b062-d07f26bc180d req-0a3b368a-d050-4cb7-95f4-77f202ede852 service nova] Releasing lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-d114e0ec-8c21-4db3-958e-276ded0f2ff1 req-9411922c-e1b2-4577-a491-67e0b35708b9 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d114e0ec-8c21-4db3-958e-276ded0f2ff1 req-9411922c-e1b2-4577-a491-67e0b35708b9 service nova] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d114e0ec-8c21-4db3-958e-276ded0f2ff1 req-9411922c-e1b2-4577-a491-67e0b35708b9 service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d114e0ec-8c21-4db3-958e-276ded0f2ff1 req-9411922c-e1b2-4577-a491-67e0b35708b9 service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-d114e0ec-8c21-4db3-958e-276ded0f2ff1 req-9411922c-e1b2-4577-a491-67e0b35708b9 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] No waiting events found dispatching network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:44 user nova-compute[75233]: WARNING nova.compute.manager [req-d114e0ec-8c21-4db3-958e-276ded0f2ff1 req-9411922c-e1b2-4577-a491-67e0b35708b9 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received unexpected event network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae for instance with vm_state active and task_state None.
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] No waiting events found dispatching network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:46 user nova-compute[75233]: WARNING nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received unexpected event network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae for instance with vm_state active and task_state None.
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] No waiting events found dispatching network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:46 user nova-compute[75233]: WARNING nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received unexpected event network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 for instance with vm_state building and task_state spawning.
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] No waiting events found dispatching network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:49:46 user nova-compute[75233]: WARNING nova.compute.manager [req-3cb7b462-50c0-42bf-8887-0a68669ff467 req-cfe0213e-f026-459c-b85d-f9ee6d6ee07b service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received unexpected event network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 for instance with vm_state building and task_state spawning.
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Instance spawned successfully.
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:49:46 user nova-compute[75233]: INFO nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Took 5.43 seconds to spawn the instance on the hypervisor.
Dec 05 13:49:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:49:46 user nova-compute[75233]: INFO nova.compute.manager [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Took 6.33 seconds to build instance.
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c7f0450f-e7f2-4fbe-b109-7c8b56354909 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.432s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:49:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:52 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:52 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7426MB free_disk=25.096466064453125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 84e303d2-b587-4574-bd33-d682e74289a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b4b42e4d-f5e2-48ec-842a-536a1f250585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 4f0cc131-8133-40a7-b331-6c87051b7646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fba66d11-7258-45dd-9d43-d6243d334d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fc9d177a-43bf-4644-bc62-f7203019d911 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5f8c968a-c8fb-4399-8c0d-4fa208739ada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 13:49:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:49:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:49:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:49:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-changed-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Refreshing instance network info cache due to event network-changed-7620b802-6381-4721-a397-881e11466092. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] Acquiring lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] Acquired lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.network.neutron [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Refreshing network info cache for port 7620b802-6381-4721-a397-881e11466092 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.network.neutron [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updated VIF entry in instance network info cache for port 7620b802-6381-4721-a397-881e11466092. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.network.neutron [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updating instance_info_cache with network_info: [{"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2a33cbe5-ca62-445d-931f-0d09efb5d780 req-c7b680e1-502d-479b-ae2e-4dfbcc5cbbee service nova] Releasing lock "refresh_cache-fba66d11-7258-45dd-9d43-d6243d334d16" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'flavor' on Instance uuid fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:49:56 user nova-compute[75233]: INFO nova.compute.manager [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attaching volume 38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 to /dev/vdb
Dec 05 13:49:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [{"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG os_brick.utils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e885070-ecc1-4a37-a5c2-6b9a795f5f69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc469eb5-7b23-41dc-9838-af22e5aa49ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d98ec48-0c98-4227-bae8-473752b645ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08167669-7827-409b-94a2-02a359f81986]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:49:56 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b8522-0e62-4d68-aee7-226254d37412]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG os_brick.utils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updating existing volume attachment record: f5000c93-63b1-4361-b370-5e243bb9f444 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:49:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:57 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84e303d2-b587-4574-bd33-d682e74289a9 is timed out.
Dec 05 13:49:57 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Successfully detached device vdb from instance 84e303d2-b587-4574-bd33-d682e74289a9 from the live domain config.
Dec 05 13:49:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUxZIezS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:49:57 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8abd6a1-6259-491a-8a42-c50e22f8c022]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:49:57 user nova-compute[75233]: No targets found.
Dec 05 13:49:57 user nova-compute[75233]: iSNS:
Dec 05 13:49:57 user nova-compute[75233]: No targets found.
Dec 05 13:49:57 user nova-compute[75233]: STATIC:
Dec 05 13:49:57 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:49:57 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:57 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:57 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:49:57 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:57 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:57 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9
Dec 05 13:49:57 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:57 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:57 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:49:57 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:57 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:57 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:49:57 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:49:57 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:49:57 user nova-compute[75233]: FIRMWARE:
Dec 05 13:49:57 user nova-compute[75233]: No targets found.
Dec 05 13:49:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:49:57 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:49:57 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fbda69-df53-4017-b1a0-3eb115aa5191]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa86d1-8c9d-4951-8a43-5ab34b10e8e0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:49:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:49:57 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:49:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586ab880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[565209cd-13aa-4dcd-87bc-490e2c99bc0d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8708c69-810c-4fee-a365-91ac2bce1f5b]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d98c505-5705-4751-9c88-12744b105b45]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f0a1b-f38d-4ff6-aa75-603fbc15a141]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb4e929-61bf-444d-ad11-d0322431dda8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.138s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a3b81-1e41-4aac-997f-4ec63bd19c6f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260]
Dec 05 13:49:57 user nova-compute[75233]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9, portal: 172.16.0.220,3260] successful.
Dec 05 13:49:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6220ccb4-1144-4c73-a00b-4915ad5a2bf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[951a4b2b-fbf3-4d85-8472-9b573b4dbf99]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] <== disconnect_volume: return (391ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'flavor' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:49:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8522b0b7-b9f0-451f-93ff-11469846fe08 tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:06 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041753b-a8a8-425f-bc7a-cd80abe23d4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:50:06 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7071a876-ed0c-4233-b38f-b745b38862c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3] added
Dec 05 13:50:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e9728e-3520-4808-ae9d-cbc60f0affe9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a7006-0d0e-4447-ba7f-3dc2b5283c6c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztlnbXTO {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztlnbXTO" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0efdca4-2ef3-49b1-b53b-fdc215347eb9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztlnbXTO'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f755475-690a-4b24-942c-a8888a29c2ff]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe99af-b582-4e48-9c38-b9bb96952ec4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4672df3-6e98-4747-9dca-8393d1d74117]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]
Dec 05 13:50:06 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.
Dec 05 13:50:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086a0e6-ae8f-48c5-b0d6-5286cd0c9cc7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f777b3-48db-4aad-ba99-568a9767c49a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:06 user nova-compute[75233]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[163882c5-ae6f-4bd7-bea7-9c44bfe31a75]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:50:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23731636564303030', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731636564303030', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'flavor' on Instance uuid fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:50:07 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:07 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:50:07 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:07 user nova-compute[75233]:   <serial>38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3</serial>
Dec 05 13:50:07 user nova-compute[75233]: </disk>
Dec 05 13:50:07 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No VIF found with MAC fa:16:3e:a5:38:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1df6320a-c031-417c-90b3-81ec01e227fd tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.790s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:08 user nova-compute[75233]: INFO nova.compute.manager [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Rebuilding instance
Dec 05 13:50:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:50:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-d61544c3-1940-4ee0-84c5-7a56243a622a req-cebd84c6-8413-450c-b42a-0a44bb429899 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-unplugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d61544c3-1940-4ee0-84c5-7a56243a622a req-cebd84c6-8413-450c-b42a-0a44bb429899 service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d61544c3-1940-4ee0-84c5-7a56243a622a req-cebd84c6-8413-450c-b42a-0a44bb429899 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d61544c3-1940-4ee0-84c5-7a56243a622a req-cebd84c6-8413-450c-b42a-0a44bb429899 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-d61544c3-1940-4ee0-84c5-7a56243a622a req-cebd84c6-8413-450c-b42a-0a44bb429899 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-unplugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:09 user nova-compute[75233]: WARNING nova.compute.manager [req-d61544c3-1940-4ee0-84c5-7a56243a622a req-cebd84c6-8413-450c-b42a-0a44bb429899 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-unplugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state active and task_state rebuilding.
Dec 05 13:50:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance destroyed successfully.
Dec 05 13:50:09 user nova-compute[75233]: INFO nova.compute.manager [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Detaching volume 38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:50:09 user nova-compute[75233]: INFO nova.virt.block_device [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attempting to driver detach volume 38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 from mountpoint /dev/vdb
Dec 05 13:50:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Attempting to detach device vdb from instance fba66d11-7258-45dd-9d43-d6243d334d16 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:50:09 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:09 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:50:09 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:09 user nova-compute[75233]:   <serial>38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3</serial>
Dec 05 13:50:09 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:50:09 user nova-compute[75233]: </disk>
Dec 05 13:50:09 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:50:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully detached device vdb from instance fba66d11-7258-45dd-9d43-d6243d334d16 from the persistent domain config.
Dec 05 13:50:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:09 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d787ac7-bb44-4ca9-860d-2a3713394bc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:50:09 user nova-compute[75233]: No targets found.
Dec 05 13:50:09 user nova-compute[75233]: iSNS:
Dec 05 13:50:09 user nova-compute[75233]: No targets found.
Dec 05 13:50:09 user nova-compute[75233]: STATIC:
Dec 05 13:50:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:50:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:50:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:50:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:50:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:09 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:50:09 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:09 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:09 user nova-compute[75233]: FIRMWARE:
Dec 05 13:50:09 user nova-compute[75233]: No targets found.
Dec 05 13:50:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:50:09 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:50:09 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb97724d-979a-45f1-bb3e-95c6e09736f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae50db1-cfeb-4d6a-8670-9426840d6fce]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:09 user nova-compute[75233]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:09 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f600e5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:50:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ae22bc-2089-48ce-8bf6-7f221cdc22d2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d102b279-c1d3-4817-83fa-4c250aec71fd]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb370489-5523-41cd-9526-c0e174c3bf61]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c3121a-cc2a-4c55-9283-a9ab967e22b0]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a081718-a6a0-46e4-87f4-80ca2e368b9d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f52332-547e-4bcc-9160-d6d4b27d5fcd]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]
Dec 05 13:50:10 user nova-compute[75233]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.
Dec 05 13:50:10 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d341c0-f041-46c3-ae37-b58b3bbbc96d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== disconnect_volume: return (297ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:50:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance destroyed successfully.
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1578695365',display_name='tempest-ServerActionsTestOtherA-server-1393086925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1578695365',id=23,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2aipfGk9HZY+V9iR6F0Sb1fi8n5MWQBWblZVcpCDCSsj+DE07vFNMf3l17q6NduKyPOjiOyJyh0mIGrWeTQ3Ko/XAtOQSdBAislQFq4jImzaXh1gAjPT/8p5R03T9rA==',key_name='tempest-keypair-798902531',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:48:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-dr7was46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=fba66d11-7258-45dd-9d43-d6243d334d16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7620b802-63, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdb2899f-64b7-4e10-8804-31f3b75da36a) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:11 user nova-compute[75233]: INFO os_vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63')
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:11 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[730a9a98-646a-4a10-a31a-edf3f11e5507]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:50:11 user nova-compute[75233]: No targets found.
Dec 05 13:50:11 user nova-compute[75233]: iSNS:
Dec 05 13:50:11 user nova-compute[75233]: No targets found.
Dec 05 13:50:11 user nova-compute[75233]: STATIC:
Dec 05 13:50:11 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:50:11 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:11 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:11 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:50:11 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:11 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:11 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:50:11 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:11 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:11 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:50:11 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:11 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:11 user nova-compute[75233]: FIRMWARE:
Dec 05 13:50:11 user nova-compute[75233]: No targets found.
Dec 05 13:50:11 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:50:11 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:50:11 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb62700-00cf-496c-b5ed-8e7a770f5c00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[428232a9-ef5c-4cdb-b94c-86fb67b828cf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:11 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:11 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:11 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:11 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:11 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:11 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:11 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:11 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f6012f5b0>, {}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Disconnecting from: [] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== disconnect_volume: return (72ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:50:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Deleting instance files /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16_del
Dec 05 13:50:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Deletion of /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16_del complete
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-0cd0137f-4222-4bbb-ae4e-9e2748da89de req-53366914-4698-48ab-a6db-97ada65a5bc2 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0cd0137f-4222-4bbb-ae4e-9e2748da89de req-53366914-4698-48ab-a6db-97ada65a5bc2 service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0cd0137f-4222-4bbb-ae4e-9e2748da89de req-53366914-4698-48ab-a6db-97ada65a5bc2 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0cd0137f-4222-4bbb-ae4e-9e2748da89de req-53366914-4698-48ab-a6db-97ada65a5bc2 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-0cd0137f-4222-4bbb-ae4e-9e2748da89de req-53366914-4698-48ab-a6db-97ada65a5bc2 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:11 user nova-compute[75233]: WARNING nova.compute.manager [req-0cd0137f-4222-4bbb-ae4e-9e2748da89de req-53366914-4698-48ab-a6db-97ada65a5bc2 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state active and task_state rebuilding.
Dec 05 13:50:11 user nova-compute[75233]: INFO nova.virt.block_device [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Booting with volume 38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 at /dev/vdb
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.utils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ac1b7-2938-4cac-903c-6a9c04431177]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a341ccf-720c-4b61-bbcb-336cd0f4b90d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f197538-1485-4a3a-84db-6848c5f3a6af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c445a6e-a396-49aa-b1b0-a7af70426ff6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:50:11 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:50:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4ee45-9f56-4d2b-bcb9-3b8d525270b8]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG os_brick.utils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:11 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updating existing volume attachment record: 5736aecb-90dd-450b-82a7-602a4dac4add {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-changed-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Refreshing instance network info cache due to event network-changed-236f8926-bbb2-4319-9d65-ca9c4e149d29. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] Acquiring lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] Acquired lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Refreshing network info cache for port 236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updated VIF entry in instance network info cache for port 236f8926-bbb2-4319-9d65-ca9c4e149d29. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG nova.network.neutron [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updating instance_info_cache with network_info: [{"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:50:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6e349dd3-b901-4ba2-98e4-764260de3b51 req-8cb1f834-84ec-4345-b23d-02ab1be08163 service nova] Releasing lock "refresh_cache-fc9d177a-43bf-4644-bc62-f7203019d911" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:50:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lazy-loading 'flavor' on Instance uuid fc9d177a-43bf-4644-bc62-f7203019d911 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:16 user nova-compute[75233]: INFO nova.compute.manager [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Attaching volume ccbd3abb-318b-42d3-aac3-f722e7e1e062 to /dev/vdb
Dec 05 13:50:16 user nova-compute[75233]: DEBUG os_brick.utils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0733e53a-b407-4cf9-bf68-90b1b11b170e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8385c75-9a89-49ba-8919-7047ad4a6641]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab25817b-5b9f-44ce-a381-98ae7f483339]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c576a0-30a7-4a0c-b4d6-c6e17c1cb40e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:50:16 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:50:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[990802a7-6fb2-4ffc-96bc-09884c94a3a4]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG os_brick.utils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:16 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updating existing volume attachment record: 0c43929c-92f9-436d-bcd2-ec2bc37ec9d4 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:50:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:50:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Creating image(s)
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk 1073741824" returned: 0 in 0.047s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:50:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:22 user nova-compute[75233]: INFO nova.compute.manager [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Detaching volume 1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Cannot resize image /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Ensure instance console log exists: /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Start _get_guest_xml network_info=[{"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fba66d11-7258-45dd-9d43-d6243d334d16', 'attached_at': '', 'detached_at': '', 'volume_id': '38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'serial': '38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3'}, 'delete_on_termination': False, 'attachment_id': '5736aecb-90dd-450b-82a7-602a4dac4add', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:50:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 13:50:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.objects.instance [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'vcpu_model' on Instance uuid fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:22 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:22 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:22 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:50:22 user nova-compute[75233]: INFO nova.virt.block_device [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Attempting to driver detach volume 1c48c470-ff2e-4d63-9fcf-9199c5a5741c from mountpoint /dev/vdb
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Attempting to detach device vdb from instance 47d20f82-0294-43b9-97a3-7ae8c564d08d from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:50:22 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:22 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:50:22 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:22 user nova-compute[75233]:   <serial>1c48c470-ff2e-4d63-9fcf-9199c5a5741c</serial>
Dec 05 13:50:22 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 13:50:22 user nova-compute[75233]: </disk>
Dec 05 13:50:22 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1139da93-1d22-4275-965f-91e9955910e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:50:22 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully detached device vdb from instance 47d20f82-0294-43b9-97a3-7ae8c564d08d from the persistent domain config.
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47d20f82-0294-43b9-97a3-7ae8c564d08d from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:50:22 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:22 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:50:22 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:22 user nova-compute[75233]:   <serial>1c48c470-ff2e-4d63-9fcf-9199c5a5741c</serial>
Dec 05 13:50:22 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 13:50:22 user nova-compute[75233]: </disk>
Dec 05 13:50:22 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3978e8df-28af-4f42-86ef-a9a2af792d08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3] added
Dec 05 13:50:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c9fc6-568d-4112-9f11-3e5953cd343e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f66b89-6213-4e16-aaf9-0bc65317b83b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztlnbXTO {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztlnbXTO" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb5f8d-1ddc-4fef-9774-3f6e952d38a0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztlnbXTO'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6686311b-479a-4f73-b459-018405e76020]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86566efc-b8c4-4d01-a1a3-9043a367c8d3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9c3ba1-d9dc-45cd-89f0-a2df73e229db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]
Dec 05 13:50:22 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.
Dec 05 13:50:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e866106-029c-48c5-ab42-abf9cc37f68c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f236955-8782-4111-9e6b-2182bfa06b68]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:22 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8467fd-a7fd-4e27-ada9-1a93a0a71458]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:50:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23731636564303030', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731636564303030', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1578695365',display_name='tempest-ServerActionsTestOtherA-server-1393086925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1578695365',id=23,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2aipfGk9HZY+V9iR6F0Sb1fi8n5MWQBWblZVcpCDCSsj+DE07vFNMf3l17q6NduKyPOjiOyJyh0mIGrWeTQ3Ko/XAtOQSdBAislQFq4jImzaXh1gAjPT/8p5R03T9rA==',key_name='tempest-keypair-798902531',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:48:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-dr7was46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=fba66d11-7258-45dd-9d43-d6243d334d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:50:23 user nova-compute[75233]:   <uuid>fba66d11-7258-45dd-9d43-d6243d334d16</uuid>
Dec 05 13:50:23 user nova-compute[75233]:   <name>instance-00000017</name>
Dec 05 13:50:23 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:50:23 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:50:23 user nova-compute[75233]:   <metadata>
Dec 05 13:50:23 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:50:23 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:50:23 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherA-server-1393086925</nova:name>
Dec 05 13:50:23 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:50:22</nova:creationTime>
Dec 05 13:50:23 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:50:23 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:50:23 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:50:23 user nova-compute[75233]:       <nova:owner>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:user uuid="5414614ea59f4b26938bf55a492e5ddd">tempest-ServerActionsTestOtherA-875899137-project-member</nova:user>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:project uuid="405f4ac4b28d405fb6f71f29c6557517">tempest-ServerActionsTestOtherA-875899137</nova:project>
Dec 05 13:50:23 user nova-compute[75233]:       </nova:owner>
Dec 05 13:50:23 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:50:23 user nova-compute[75233]:       <nova:ports>
Dec 05 13:50:23 user nova-compute[75233]:         <nova:port uuid="7620b802-6381-4721-a397-881e11466092">
Dec 05 13:50:23 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 13:50:23 user nova-compute[75233]:         </nova:port>
Dec 05 13:50:23 user nova-compute[75233]:       </nova:ports>
Dec 05 13:50:23 user nova-compute[75233]:     </nova:instance>
Dec 05 13:50:23 user nova-compute[75233]:   </metadata>
Dec 05 13:50:23 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:50:23 user nova-compute[75233]:     <system>
Dec 05 13:50:23 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:50:23 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:50:23 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:50:23 user nova-compute[75233]:       <entry name="serial">fba66d11-7258-45dd-9d43-d6243d334d16</entry>
Dec 05 13:50:23 user nova-compute[75233]:       <entry name="uuid">fba66d11-7258-45dd-9d43-d6243d334d16</entry>
Dec 05 13:50:23 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:50:23 user nova-compute[75233]:     </system>
Dec 05 13:50:23 user nova-compute[75233]:   </sysinfo>
Dec 05 13:50:23 user nova-compute[75233]:   <os>
Dec 05 13:50:23 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:50:23 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:50:23 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:50:23 user nova-compute[75233]:   </os>
Dec 05 13:50:23 user nova-compute[75233]:   <features>
Dec 05 13:50:23 user nova-compute[75233]:     <acpi/>
Dec 05 13:50:23 user nova-compute[75233]:     <apic/>
Dec 05 13:50:23 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:50:23 user nova-compute[75233]:   </features>
Dec 05 13:50:23 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:50:23 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:50:23 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:50:23 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:50:23 user nova-compute[75233]:   </clock>
Dec 05 13:50:23 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:50:23 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:50:23 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:50:23 user nova-compute[75233]:   </cpu>
Dec 05 13:50:23 user nova-compute[75233]:   <devices>
Dec 05 13:50:23 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:50:23 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:50:23 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk"/>
Dec 05 13:50:23 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:50:23 user nova-compute[75233]:     </disk>
Dec 05 13:50:23 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:50:23 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:23 user nova-compute[75233]:       <source dev="/dev/sdd"/>
Dec 05 13:50:23 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:50:23 user nova-compute[75233]:       <serial>38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3</serial>
Dec 05 13:50:23 user nova-compute[75233]:     </disk>
Dec 05 13:50:23 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:50:23 user nova-compute[75233]:       <mac address="fa:16:3e:a5:38:cd"/>
Dec 05 13:50:23 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:50:23 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:50:23 user nova-compute[75233]:       <target dev="tap7620b802-63"/>
Dec 05 13:50:23 user nova-compute[75233]:     </interface>
Dec 05 13:50:23 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:50:23 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/console.log" append="off"/>
Dec 05 13:50:23 user nova-compute[75233]:     </serial>
Dec 05 13:50:23 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:50:23 user nova-compute[75233]:     <video>
Dec 05 13:50:23 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:50:23 user nova-compute[75233]:     </video>
Dec 05 13:50:23 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:50:23 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:50:23 user nova-compute[75233]:     </rng>
Dec 05 13:50:23 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:50:23 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:50:23 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:50:23 user nova-compute[75233]:     </memballoon>
Dec 05 13:50:23 user nova-compute[75233]:   </devices>
Dec 05 13:50:23 user nova-compute[75233]: </domain>
Dec 05 13:50:23 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1578695365',display_name='tempest-ServerActionsTestOtherA-server-1393086925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1578695365',id=23,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2aipfGk9HZY+V9iR6F0Sb1fi8n5MWQBWblZVcpCDCSsj+DE07vFNMf3l17q6NduKyPOjiOyJyh0mIGrWeTQ3Ko/XAtOQSdBAislQFq4jImzaXh1gAjPT/8p5R03T9rA==',key_name='tempest-keypair-798902531',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:48:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-dr7was46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=fba66d11-7258-45dd-9d43-d6243d334d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG os_vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0122abfa-7de4-5c7f-bc1f-70f800c5a44c', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7620b802-63, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7620b802-63, col_values=(('qos', UUID('86f5175f-886a-4416-a788-2c99a16da467')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7620b802-63, col_values=(('external_ids', {'iface-id': '7620b802-6381-4721-a397-881e11466092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:38:cd', 'vm-uuid': 'fba66d11-7258-45dd-9d43-d6243d334d16'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:23 user nova-compute[75233]: INFO os_vif [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63')
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:50:23 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No VIF found with MAC fa:16:3e:a5:38:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:50:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-c162c014-37db-40f0-8480-6234091b268d req-905a6d88-f72c-4d0f-9114-ecd9af531d75 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c162c014-37db-40f0-8480-6234091b268d req-905a6d88-f72c-4d0f-9114-ecd9af531d75 service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c162c014-37db-40f0-8480-6234091b268d req-905a6d88-f72c-4d0f-9114-ecd9af531d75 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c162c014-37db-40f0-8480-6234091b268d req-905a6d88-f72c-4d0f-9114-ecd9af531d75 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-c162c014-37db-40f0-8480-6234091b268d req-905a6d88-f72c-4d0f-9114-ecd9af531d75 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:25 user nova-compute[75233]: WARNING nova.compute.manager [req-c162c014-37db-40f0-8480-6234091b268d req-905a6d88-f72c-4d0f-9114-ecd9af531d75 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state active and task_state rebuild_spawning.
Dec 05 13:50:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhYHLvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:26 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab7422d-1327-4027-b970-4aace0c53419]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:50:26 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c0111-f952-4bb1-a87f-4f3261a386ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062] added
Dec 05 13:50:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b24eb-94bb-4e3e-9943-c8262acbb3b8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b6845-dfcc-455a-b109-220798f8d9c6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrhYHLvC {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrhYHLvC" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb0992b-dd24-404b-99b1-42d91fb610c5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrhYHLvC'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4404c430-f0dd-44a1-99bb-79f243eb238a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2c95e9-5637-4543-8341-15037699301b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c30c65f-5526-4f27-a3cd-bd747829e8ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260]
Dec 05 13:50:26 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260] successful.
Dec 05 13:50:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c660c1-fde5-47cb-93e1-35c2b1d686c1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0851ca9d-5cc4-4567-ab8d-4fcc1572e611]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)
Dec 05 13:50:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12d910b-65c9-49b9-baae-c9398552a395]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:50:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance spawned successfully.
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-d88b4079-c1cd-4a5e-96f4-77b41f659061 req-4aaffdfd-fd76-4475-8903-619cbc568aa4 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d88b4079-c1cd-4a5e-96f4-77b41f659061 req-4aaffdfd-fd76-4475-8903-619cbc568aa4 service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d88b4079-c1cd-4a5e-96f4-77b41f659061 req-4aaffdfd-fd76-4475-8903-619cbc568aa4 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d88b4079-c1cd-4a5e-96f4-77b41f659061 req-4aaffdfd-fd76-4475-8903-619cbc568aa4 service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-d88b4079-c1cd-4a5e-96f4-77b41f659061 req-4aaffdfd-fd76-4475-8903-619cbc568aa4 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:27 user nova-compute[75233]: WARNING nova.compute.manager [req-d88b4079-c1cd-4a5e-96f4-77b41f659061 req-4aaffdfd-fd76-4475-8903-619cbc568aa4 service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state active and task_state rebuild_spawning.
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75233) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:27 user nova-compute[75233]: INFO nova.compute.manager [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Terminating instance
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-938c8b6f-630b-4164-b458-f246c06f1d71 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-01920074-d2e9-4b23-8fe1-921c8085f3ab req-a71bf0a4-4121-413c-8829-89b8b8822129 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-unplugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01920074-d2e9-4b23-8fe1-921c8085f3ab req-a71bf0a4-4121-413c-8829-89b8b8822129 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01920074-d2e9-4b23-8fe1-921c8085f3ab req-a71bf0a4-4121-413c-8829-89b8b8822129 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01920074-d2e9-4b23-8fe1-921c8085f3ab req-a71bf0a4-4121-413c-8829-89b8b8822129 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-01920074-d2e9-4b23-8fe1-921c8085f3ab req-a71bf0a4-4121-413c-8829-89b8b8822129 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-unplugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-01920074-d2e9-4b23-8fe1-921c8085f3ab req-a71bf0a4-4121-413c-8829-89b8b8822129 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-unplugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhYHLvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23331656262353538', 'path': '/dev/sdg'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331656262353538', 'path': '/dev/sdg'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lazy-loading 'flavor' on Instance uuid fc9d177a-43bf-4644-bc62-f7203019d911 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:50:27 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:27 user nova-compute[75233]:   <source dev="/dev/sdg"/>
Dec 05 13:50:27 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:27 user nova-compute[75233]:   <serial>ccbd3abb-318b-42d3-aac3-f722e7e1e062</serial>
Dec 05 13:50:27 user nova-compute[75233]: </disk>
Dec 05 13:50:27 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Instance destroyed successfully.
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lazy-loading 'resources' on Instance uuid 84e303d2-b587-4574-bd33-d682e74289a9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1683810375',display_name='tempest-TestServerVolumeAttachmentScenario-server-1683810375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1683810375',id=19,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqSaVHO8f60RVcpGIEkfGhT9t+LWFG/9rjTmFbkF4pAOdZ3b5tTBnESEF5bqo6LIIwex1OJk/TCZ0fUJkUEpZOQO1YNvkpqMic5Xit5SYfe8E3ENPqn0Xrg/Kffgr1sNg==',key_name='tempest-keypair-55988495',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:46:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b2ce2c635bf41cb858f09061d5491bc',ramdisk_id='',reservation_id='r-yu50bo6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1500715046',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1500715046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf813870948a4870b545b0e886df6567',uuid=84e303d2-b587-4574-bd33-d682e74289a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Converting VIF {"id": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "address": "fa:16:3e:b0:f9:be", "network": {"id": "78fdd011-fd04-433d-b84a-0668c95fbd64", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-911629019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b2ce2c635bf41cb858f09061d5491bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa063bc7-cc", "ovs_interfaceid": "fa063bc7-cc2e-44b9-99b5-723c5ce240cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG os_vif [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa063bc7-cc, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f039b31-ed2b-4b98-b03b-a086ee64fc15) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: INFO os_vif [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f9:be,bridge_name='br-int',has_traffic_filtering=True,id=fa063bc7-cc2e-44b9-99b5-723c5ce240cf,network=Network(78fdd011-fd04-433d-b84a-0668c95fbd64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa063bc7-cc')
Dec 05 13:50:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Deleting instance files /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9_del
Dec 05 13:50:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Deletion of /opt/stack/data/nova/instances/84e303d2-b587-4574-bd33-d682e74289a9_del complete
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] No VIF found with MAC fa:16:3e:20:df:df, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:50:28 user nova-compute[75233]: INFO nova.compute.manager [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Took 1.25 seconds to destroy the instance on the hypervisor.
Dec 05 13:50:28 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5872d519-778e-460a-849c-f585aac8867e tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.045s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:50:29 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Took 0.75 seconds to deallocate network for instance.
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-faf787b5-fae4-47dc-8c6d-071826b4f3c8 req-e53fe03c-0d55-4c31-ba3b-2d23a94e75d3 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-deleted-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:29 user nova-compute[75233]: WARNING nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state deleted and task_state None.
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:29 user nova-compute[75233]: WARNING nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state deleted and task_state None.
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:29 user nova-compute[75233]: WARNING nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state deleted and task_state None.
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-unplugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-unplugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:29 user nova-compute[75233]: WARNING nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-unplugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state deleted and task_state None.
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Acquiring lock "84e303d2-b587-4574-bd33-d682e74289a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] Lock "84e303d2-b587-4574-bd33-d682e74289a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] No waiting events found dispatching network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:29 user nova-compute[75233]: WARNING nova.compute.manager [req-e17ccb73-e3a8-4046-8efe-e45fd8e6846a req-3cc79228-7bbd-4589-a90d-465994148901 service nova] [instance: 84e303d2-b587-4574-bd33-d682e74289a9] Received unexpected event network-vif-plugged-fa063bc7-cc2e-44b9-99b5-723c5ce240cf for instance with vm_state deleted and task_state None.
Dec 05 13:50:29 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Deleted allocations for instance 84e303d2-b587-4574-bd33-d682e74289a9
Dec 05 13:50:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5d37ca9f-edd2-4c9c-b2a3-b0ca8564c7be tempest-TestServerVolumeAttachmentScenario-1500715046 tempest-TestServerVolumeAttachmentScenario-1500715046-project-member] Lock "84e303d2-b587-4574-bd33-d682e74289a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.664s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:30 user nova-compute[75233]: INFO nova.compute.manager [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Detaching volume ccbd3abb-318b-42d3-aac3-f722e7e1e062
Dec 05 13:50:30 user nova-compute[75233]: INFO nova.virt.block_device [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Attempting to driver detach volume ccbd3abb-318b-42d3-aac3-f722e7e1e062 from mountpoint /dev/vdb
Dec 05 13:50:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Attempting to detach device vdb from instance fc9d177a-43bf-4644-bc62-f7203019d911 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:50:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:50:30 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:30 user nova-compute[75233]:   <source dev="/dev/sdg"/>
Dec 05 13:50:30 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:30 user nova-compute[75233]:   <serial>ccbd3abb-318b-42d3-aac3-f722e7e1e062</serial>
Dec 05 13:50:30 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:50:30 user nova-compute[75233]: </disk>
Dec 05 13:50:30 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:50:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Successfully detached device vdb from instance fc9d177a-43bf-4644-bc62-f7203019d911 from the persistent domain config.
Dec 05 13:50:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc9d177a-43bf-4644-bc62-f7203019d911 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:50:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:50:30 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:50:30 user nova-compute[75233]:   <source dev="/dev/sdg"/>
Dec 05 13:50:30 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:50:30 user nova-compute[75233]:   <serial>ccbd3abb-318b-42d3-aac3-f722e7e1e062</serial>
Dec 05 13:50:30 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:50:30 user nova-compute[75233]: </disk>
Dec 05 13:50:30 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:50:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc9d177a-43bf-4644-bc62-f7203019d911 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:50:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:50:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:50:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:50:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:50:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:42 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47d20f82-0294-43b9-97a3-7ae8c564d08d is timed out.
Dec 05 13:50:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully detached device vdb from instance 47d20f82-0294-43b9-97a3-7ae8c564d08d from the live domain config.
Dec 05 13:50:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyOjtDNb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:42 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7dc958-0df5-49d3-9b85-8d6252b5ab4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:50:42 user nova-compute[75233]: No targets found.
Dec 05 13:50:42 user nova-compute[75233]: iSNS:
Dec 05 13:50:42 user nova-compute[75233]: No targets found.
Dec 05 13:50:42 user nova-compute[75233]: STATIC:
Dec 05 13:50:42 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:50:42 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:42 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:42 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:50:42 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:42 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:42 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:50:42 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:42 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:42 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:50:42 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:42 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:42 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c
Dec 05 13:50:42 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:42 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:42 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062
Dec 05 13:50:42 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:42 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:42 user nova-compute[75233]: FIRMWARE:
Dec 05 13:50:42 user nova-compute[75233]: No targets found.
Dec 05 13:50:42 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:50:42 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:50:42 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[950929a7-3493-49af-a210-7caacbdc6b9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28342820-5d2e-4017-b68a-4d98cfeb4e74]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)
Dec 05 13:50:42 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34500430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ed847-08cb-4aea-9201-ccb9c13cdca7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7c3eb-a79b-4c1f-ad21-7ce62c88278d]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfde882-1eb3-47ae-a22c-2885fc51e1dd]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bb294f-6f3c-4946-a47d-1599b2c958ad]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea67a7c7-db6c-48c3-a654-2bd916f4c738]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[423830b0-1e71-419b-b6a8-a19bd149c353]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260]
Dec 05 13:50:42 user nova-compute[75233]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c, portal: 172.16.0.220,3260] successful.
Dec 05 13:50:42 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c48c470-ff2e-4d63-9fcf-9199c5a5741c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b415f4-27f6-4b06-a2bd-fde0b2747a06]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== disconnect_volume: return (318ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:50:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:50:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:43 user nova-compute[75233]: DEBUG nova.objects.instance [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf4fe963-3b25-470e-8155-a6b80d93845b tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75233) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-ae1d2f12-8405-46dd-97af-9d6100dafa62 req-15f19da2-a1a0-41ee-8ed8-c49170a297dd service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae1d2f12-8405-46dd-97af-9d6100dafa62 req-15f19da2-a1a0-41ee-8ed8-c49170a297dd service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae1d2f12-8405-46dd-97af-9d6100dafa62 req-15f19da2-a1a0-41ee-8ed8-c49170a297dd service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae1d2f12-8405-46dd-97af-9d6100dafa62 req-15f19da2-a1a0-41ee-8ed8-c49170a297dd service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-ae1d2f12-8405-46dd-97af-9d6100dafa62 req-15f19da2-a1a0-41ee-8ed8-c49170a297dd service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:45 user nova-compute[75233]: WARNING nova.compute.manager [req-ae1d2f12-8405-46dd-97af-9d6100dafa62 req-15f19da2-a1a0-41ee-8ed8-c49170a297dd service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state active and task_state powering-off.
Dec 05 13:50:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance destroyed successfully.
Dec 05 13:50:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:50:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-52ce2d9d-b9c2-44b1-aaa0-949a7bee24b3 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.969s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-3ff0735c-70ca-4898-841e-0b611f1cdacd req-1171630e-41bd-4bf7-aeb4-4ccbe6ebff45 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:50:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3ff0735c-70ca-4898-841e-0b611f1cdacd req-1171630e-41bd-4bf7-aeb4-4ccbe6ebff45 service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3ff0735c-70ca-4898-841e-0b611f1cdacd req-1171630e-41bd-4bf7-aeb4-4ccbe6ebff45 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3ff0735c-70ca-4898-841e-0b611f1cdacd req-1171630e-41bd-4bf7-aeb4-4ccbe6ebff45 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-3ff0735c-70ca-4898-841e-0b611f1cdacd req-1171630e-41bd-4bf7-aeb4-4ccbe6ebff45 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:50:47 user nova-compute[75233]: WARNING nova.compute.manager [req-3ff0735c-70ca-4898-841e-0b611f1cdacd req-1171630e-41bd-4bf7-aeb4-4ccbe6ebff45 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state stopped and task_state None.
Dec 05 13:50:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:50:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc9d177a-43bf-4644-bc62-f7203019d911 is timed out.
Dec 05 13:50:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Successfully detached device vdb from instance fc9d177a-43bf-4644-bc62-f7203019d911 from the live domain config.
Dec 05 13:50:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrhYHLvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:50:51 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9046fea-cb6d-4e91-a852-3c4350fb6917]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:50:51 user nova-compute[75233]: No targets found.
Dec 05 13:50:51 user nova-compute[75233]: iSNS:
Dec 05 13:50:51 user nova-compute[75233]: No targets found.
Dec 05 13:50:51 user nova-compute[75233]: STATIC:
Dec 05 13:50:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:50:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:50:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:50:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:50:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062
Dec 05 13:50:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:50:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:50:51 user nova-compute[75233]: FIRMWARE:
Dec 05 13:50:51 user nova-compute[75233]: No targets found.
Dec 05 13:50:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:50:51 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:50:51 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[268741bc-77e1-48f1-822a-5cc95e57031d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5257577-3c71-4614-9a1f-aefcc69f47ac]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 (non-flash)
Dec 05 13:50:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34618160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062'): ({'sdg'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Removing single pathed devices sdg {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4125f2f4-2f92-441c-8b78-a4d83b507b7b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ee08e8-a586-42b7-aa0a-7803fd0a5fd4]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Flushing IO for device /dev/sdg {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29b9b9d-538a-4806-941f-eb8a3c9c573a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7e51c7-dbc7-4e7b-b7f4-f144d56dbfdd]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] SCSI volumes sdg have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579534d-5419-4fc7-ae2f-375fef024235]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05f8d6c-367b-463c-9406-d5d9958ef16d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260]
Dec 05 13:50:51 user nova-compute[75233]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062, portal: 172.16.0.220,3260] successful.
Dec 05 13:50:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbd3abb-318b-42d3-aac3-f722e7e1e062 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e7b9a-a40b-495d-a9f4-1c493259e76e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] <== disconnect_volume: return (368ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG nova.objects.instance [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lazy-loading 'flavor' on Instance uuid fc9d177a-43bf-4644-bc62-f7203019d911 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-59acd602-28b5-498d-a926-81b3fdb57ffe tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.837s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:53 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:50:53 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.066699981689453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b4b42e4d-f5e2-48ec-842a-536a1f250585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 4f0cc131-8133-40a7-b331-6c87051b7646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fba66d11-7258-45dd-9d43-d6243d334d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fc9d177a-43bf-4644-bc62-f7203019d911 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5f8c968a-c8fb-4399-8c0d-4fa208739ada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:50:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:50:54 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:50:54 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:50:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:50:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:50:57 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:50:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:50:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:50:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:50:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:50:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [{"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:50:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-5164ddc7-a09d-46b5-893c-c42aad687a3b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:50:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:50:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:51:07 user nova-compute[75233]: INFO nova.compute.manager [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Unrescuing
Dec 05 13:51:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:51:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:51:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'flavor' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-e382a0ed-c49e-4d21-adbb-83cd9035c39b req-f516c244-ee9b-41da-a50a-e606252a2573 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e382a0ed-c49e-4d21-adbb-83cd9035c39b req-f516c244-ee9b-41da-a50a-e606252a2573 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e382a0ed-c49e-4d21-adbb-83cd9035c39b req-f516c244-ee9b-41da-a50a-e606252a2573 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e382a0ed-c49e-4d21-adbb-83cd9035c39b req-f516c244-ee9b-41da-a50a-e606252a2573 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-e382a0ed-c49e-4d21-adbb-83cd9035c39b req-f516c244-ee9b-41da-a50a-e606252a2573 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:08 user nova-compute[75233]: WARNING nova.compute.manager [req-e382a0ed-c49e-4d21-adbb-83cd9035c39b req-f516c244-ee9b-41da-a50a-e606252a2573 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:51:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:08 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance destroyed successfully.
Dec 05 13:51:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:10 user nova-compute[75233]: WARNING nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:51:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:10 user nova-compute[75233]: WARNING nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:51:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:10 user nova-compute[75233]: WARNING nova.compute.manager [req-55099037-3aa4-4790-b0d1-fe2fdd7fe371 req-75ac7124-6af8-47e4-a676-98fb16c11c9f service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:51:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0f77308c-6bde-4fda-890a-5a33b8ed2e3f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:51:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:26 user nova-compute[75233]: INFO nova.compute.manager [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Terminating instance
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-changed-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Refreshing instance network info cache due to event network-changed-1cd02156-50ed-4f0d-841e-410bd36fcaae. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] Acquiring lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] Acquired lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Refreshing network info cache for port 1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:26 user nova-compute[75233]: INFO nova.compute.manager [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Terminating instance
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-708d370d-bd53-4216-a003-c264e3b24255 req-3d7259b0-029f-47b2-88a1-24622faa0a8a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-vif-unplugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-708d370d-bd53-4216-a003-c264e3b24255 req-3d7259b0-029f-47b2-88a1-24622faa0a8a service nova] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-708d370d-bd53-4216-a003-c264e3b24255 req-3d7259b0-029f-47b2-88a1-24622faa0a8a service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-708d370d-bd53-4216-a003-c264e3b24255 req-3d7259b0-029f-47b2-88a1-24622faa0a8a service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-708d370d-bd53-4216-a003-c264e3b24255 req-3d7259b0-029f-47b2-88a1-24622faa0a8a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] No waiting events found dispatching network-vif-unplugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-708d370d-bd53-4216-a003-c264e3b24255 req-3d7259b0-029f-47b2-88a1-24622faa0a8a service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-vif-unplugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Updated VIF entry in instance network info cache for port 1cd02156-50ed-4f0d-841e-410bd36fcaae. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Updating instance_info_cache with network_info: [{"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:51:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9da75b97-6967-4229-88b0-b1abb2111cdd req-1428989d-ba75-4ca5-9ece-0972348297b0 service nova] Releasing lock "refresh_cache-5f8c968a-c8fb-4399-8c0d-4fa208739ada" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Instance destroyed successfully.
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lazy-loading 'resources' on Instance uuid fc9d177a-43bf-4644-bc62-f7203019d911 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-202782527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2027825',id=24,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7yQnkgs1h3pq21nT3f1cvnXTumaK1m590C6aXwPpVACYZM2Mpnv4g0XoE3gN/+ddux6PII6viJ9fctaRyoP4Abh1w3dQWKSJx/XKEJCDpex1yaPNCIwBbh3y7QRt9RpA==',key_name='tempest-keypair-1041485488',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d23dfcfe066146e68199294937623f56',ramdisk_id='',reservation_id='r-qzpzlh98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-315527834',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8931693fe9346ac97541fe654e0da80',uuid=fc9d177a-43bf-4644-bc62-f7203019d911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Converting VIF {"id": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "address": "fa:16:3e:20:df:df", "network": {"id": "5a5bb4ca-b323-479d-85b8-42c89adaed24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-831243272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d23dfcfe066146e68199294937623f56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236f8926-bb", "ovs_interfaceid": "236f8926-bbb2-4319-9d65-ca9c4e149d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG os_vif [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap236f8926-bb, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b0f473a-a2f1-409d-a46f-427e2ad47dc1) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: INFO os_vif [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:df:df,bridge_name='br-int',has_traffic_filtering=True,id=236f8926-bbb2-4319-9d65-ca9c4e149d29,network=Network(5a5bb4ca-b323-479d-85b8-42c89adaed24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236f8926-bb')
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Deleting instance files /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911_del
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Deletion of /opt/stack/data/nova/instances/fc9d177a-43bf-4644-bc62-f7203019d911_del complete
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.compute.manager [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Took 1.01 seconds to destroy the instance on the hypervisor.
Dec 05 13:51:27 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-241ed10d-3865-4464-9528-a974e5ae2548 req-7f1a8a33-39e2-4f25-afc3-fbabd306d1f2 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-vif-unplugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-241ed10d-3865-4464-9528-a974e5ae2548 req-7f1a8a33-39e2-4f25-afc3-fbabd306d1f2 service nova] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-241ed10d-3865-4464-9528-a974e5ae2548 req-7f1a8a33-39e2-4f25-afc3-fbabd306d1f2 service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-241ed10d-3865-4464-9528-a974e5ae2548 req-7f1a8a33-39e2-4f25-afc3-fbabd306d1f2 service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-241ed10d-3865-4464-9528-a974e5ae2548 req-7f1a8a33-39e2-4f25-afc3-fbabd306d1f2 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] No waiting events found dispatching network-vif-unplugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-241ed10d-3865-4464-9528-a974e5ae2548 req-7f1a8a33-39e2-4f25-afc3-fbabd306d1f2 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-vif-unplugged-1cd02156-50ed-4f0d-841e-410bd36fcaae for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Instance destroyed successfully.
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'resources' on Instance uuid 5f8c968a-c8fb-4399-8c0d-4fa208739ada {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-652643745',display_name='tempest-AttachVolumeNegativeTest-server-652643745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-652643745',id=25,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVaAahQ9monX/qem4Xa74MHDMsUdMu3fk2VW2XJs1VTWh6WHY0XiCpYiW2RKw6gJwidqJkiHaw6n0kQIaMYROjuIkDBjj+Q8i7leYh3Gr/tVQ8ufrsh/S+KUGxG+OSjQg==',key_name='tempest-keypair-1164170049',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-vnb77fu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=5f8c968a-c8fb-4399-8c0d-4fa208739ada,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "address": "fa:16:3e:41:4e:cb", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cd02156-50", "ovs_interfaceid": "1cd02156-50ed-4f0d-841e-410bd36fcaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG os_vif [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cd02156-50, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d00db36-3d16-4b5c-945b-f318689923eb) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:27 user nova-compute[75233]: INFO os_vif [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:cb,bridge_name='br-int',has_traffic_filtering=True,id=1cd02156-50ed-4f0d-841e-410bd36fcaae,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cd02156-50')
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Deleting instance files /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada_del
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Deletion of /opt/stack/data/nova/instances/5f8c968a-c8fb-4399-8c0d-4fa208739ada_del complete
Dec 05 13:51:27 user nova-compute[75233]: INFO nova.compute.manager [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 05 13:51:27 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:51:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:51:28 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Took 0.90 seconds to deallocate network for instance.
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:28 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Deleted allocations for instance fc9d177a-43bf-4644-bc62-f7203019d911
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a5e87b3e-14ed-48f0-a13c-31449cc21c32 tempest-TestServerVolumeAttachScenarioOldVersion-315527834 tempest-TestServerVolumeAttachScenarioOldVersion-315527834-project-member] Lock "fc9d177a-43bf-4644-bc62-f7203019d911" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-1f8ed8a4-673a-40d5-bc46-b09bc812b4ac req-0f21565d-019f-4afe-9a25-9a7cd5a54a65 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1f8ed8a4-673a-40d5-bc46-b09bc812b4ac req-0f21565d-019f-4afe-9a25-9a7cd5a54a65 service nova] Acquiring lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1f8ed8a4-673a-40d5-bc46-b09bc812b4ac req-0f21565d-019f-4afe-9a25-9a7cd5a54a65 service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1f8ed8a4-673a-40d5-bc46-b09bc812b4ac req-0f21565d-019f-4afe-9a25-9a7cd5a54a65 service nova] Lock "fc9d177a-43bf-4644-bc62-f7203019d911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-1f8ed8a4-673a-40d5-bc46-b09bc812b4ac req-0f21565d-019f-4afe-9a25-9a7cd5a54a65 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] No waiting events found dispatching network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:28 user nova-compute[75233]: WARNING nova.compute.manager [req-1f8ed8a4-673a-40d5-bc46-b09bc812b4ac req-0f21565d-019f-4afe-9a25-9a7cd5a54a65 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received unexpected event network-vif-plugged-236f8926-bbb2-4319-9d65-ca9c4e149d29 for instance with vm_state deleted and task_state None.
Dec 05 13:51:29 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:51:29 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Took 1.33 seconds to deallocate network for instance.
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] Acquiring lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] No waiting events found dispatching network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:51:29 user nova-compute[75233]: WARNING nova.compute.manager [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received unexpected event network-vif-plugged-1cd02156-50ed-4f0d-841e-410bd36fcaae for instance with vm_state deleted and task_state None.
Dec 05 13:51:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-c8057281-2bd9-4c91-85f0-5fa24f678650 req-de861ab3-cab9-4706-838c-dbdd2bd79883 service nova] [instance: fc9d177a-43bf-4644-bc62-f7203019d911] Received event network-vif-deleted-236f8926-bbb2-4319-9d65-ca9c4e149d29 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:29 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Deleted allocations for instance 5f8c968a-c8fb-4399-8c0d-4fa208739ada
Dec 05 13:51:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e0fb92a6-4f77-46c5-8c10-941c4d56205b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "5f8c968a-c8fb-4399-8c0d-4fa208739ada" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-5a38caa4-836d-4ceb-b946-46e9180e020b req-3e9cd59e-69c1-4b6a-9814-66dd5377eb2a service nova] [instance: 5f8c968a-c8fb-4399-8c0d-4fa208739ada] Received event network-vif-deleted-1cd02156-50ed-4f0d-841e-410bd36fcaae {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:51:31 user nova-compute[75233]: INFO nova.compute.manager [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] instance snapshotting
Dec 05 13:51:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Beginning live snapshot process
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp070ofzoq/15f78cde230f4baf86df5462749b5962.delta 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp070ofzoq/15f78cde230f4baf86df5462749b5962.delta 1073741824" returned: 0 in 0.060s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 13:51:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:51:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 13:51:33 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 13:51:33 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:51:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp070ofzoq/15f78cde230f4baf86df5462749b5962.delta /opt/stack/data/nova/instances/snapshots/tmp070ofzoq/15f78cde230f4baf86df5462749b5962 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp070ofzoq/15f78cde230f4baf86df5462749b5962.delta /opt/stack/data/nova/instances/snapshots/tmp070ofzoq/15f78cde230f4baf86df5462749b5962" returned: 0 in 0.833s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:34 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Snapshot extracted, beginning image upload
Dec 05 13:51:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:37 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Snapshot image upload complete
Dec 05 13:51:37 user nova-compute[75233]: INFO nova.compute.manager [None req-5d9f7e99-2fd9-4494-949a-3606f9573b53 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Took 5.68 seconds to snapshot the instance on the hypervisor.
Dec 05 13:51:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:46 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:51:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:52 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:51:52 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:51:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7871MB free_disk=25.061065673828125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b4b42e4d-f5e2-48ec-842a-536a1f250585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 4f0cc131-8133-40a7-b331-6c87051b7646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fba66d11-7258-45dd-9d43-d6243d334d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:51:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:51:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:51:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:51:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:51:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:51:56 user nova-compute[75233]: INFO nova.compute.claims [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Claim successful on node user
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:51:57 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:51:57 user nova-compute[75233]: INFO nova.virt.block_device [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Booting with volume 4c688f24-405b-45d5-aaa3-25de31b3ce25 at /dev/vda
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.policy [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a35a118fda664fe5a60df4a41ea7dc05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ab64efbb5940c4a62331f4fce76a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG os_brick.utils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26afa2f-8ada-4d6c-a7dd-38485339579e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423fdde-fc1a-4c53-a973-2408d0902b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90de29b-0f63-4984-a281-974ddf940f92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b999e46-2729-4cee-9294-7a5ef0e07934]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:51:57 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:51:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5ceb5d-2c9f-4796-a9e3-98bf5a84c065]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG os_brick.utils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating existing volume attachment record: 2ef18a84-255a-4a5b-928a-4e2b6378d7ef {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:51:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Successfully created port: 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Successfully updated port: 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing instance network info cache due to event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:51:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.network.neutron [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance network_info: |[{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updated VIF entry in instance network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:51:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5c1efbba-fdfe-4d70-a8e6-c26eeb944cb7 req-95d9bfea-ec1d-4243-9871-97ee2284d127 service nova] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:00 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [{"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:52:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:03 user nova-compute[75233]: INFO nova.compute.manager [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Terminating instance
Dec 05 13:52:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-28c5fc87-d6eb-4190-a085-1e9c2a20df7e req-65c664e2-7250-4033-90a7-23429e66c117 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-28c5fc87-d6eb-4190-a085-1e9c2a20df7e req-65c664e2-7250-4033-90a7-23429e66c117 service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-28c5fc87-d6eb-4190-a085-1e9c2a20df7e req-65c664e2-7250-4033-90a7-23429e66c117 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-28c5fc87-d6eb-4190-a085-1e9c2a20df7e req-65c664e2-7250-4033-90a7-23429e66c117 service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-28c5fc87-d6eb-4190-a085-1e9c2a20df7e req-65c664e2-7250-4033-90a7-23429e66c117 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-28c5fc87-d6eb-4190-a085-1e9c2a20df7e req-65c664e2-7250-4033-90a7-23429e66c117 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-unplugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:52:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Instance destroyed successfully.
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lazy-loading 'resources' on Instance uuid ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1529541965',display_name='tempest-ServerActionsTestOtherB-server-1529541965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1529541965',id=15,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Q/d1vJwFyy51k1qr3qWJsClgeCbztIbnEbW1qfUIZeHeHDq8TPx/no5L2rRXxdMTapl3Ry7/STBXactzBGGJqA9sBrd/h7miLSxv5BL6+mR84j5mbpVXxhVx6c2AWlA==',key_name='tempest-keypair-1531939247',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='434c6a79034f4bb79f70faf8c468504e',ramdisk_id='',reservation_id='r-w29r60ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-963894040',owner_user_name='tempest-ServerActionsTestOtherB-963894040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:49:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f607b8d442c740fe865f6b96b6dcdcbd',uuid=ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converting VIF {"id": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "address": "fa:16:3e:84:db:58", "network": {"id": "ba692825-29c9-4d49-9a50-b6e1b97443aa", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1343544077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "434c6a79034f4bb79f70faf8c468504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217ff3c3-5e", "ovs_interfaceid": "217ff3c3-5eed-435e-b7b1-ec6872e83d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_vif [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217ff3c3-5e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19afd95e-1946-481f-91e4-42f9219625ab) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:04 user nova-compute[75233]: INFO os_vif [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:db:58,bridge_name='br-int',has_traffic_filtering=True,id=217ff3c3-5eed-435e-b7b1-ec6872e83d24,network=Network(ba692825-29c9-4d49-9a50-b6e1b97443aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217ff3c3-5e')
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBVwOcqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:52:04 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2158b367-faa0-4a01-8894-9221ad4d4d0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:52:04 user nova-compute[75233]: No targets found.
Dec 05 13:52:04 user nova-compute[75233]: iSNS:
Dec 05 13:52:04 user nova-compute[75233]: No targets found.
Dec 05 13:52:04 user nova-compute[75233]: STATIC:
Dec 05 13:52:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:52:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:52:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:52:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870
Dec 05 13:52:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:04 user nova-compute[75233]: FIRMWARE:
Dec 05 13:52:04 user nova-compute[75233]: No targets found.
Dec 05 13:52:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:52:04 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:52:04 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[139732ef-1a67-4913-973c-67513ee0bf5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307e22c-375d-4064-a7d5-db8086a01bf8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:04 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:52:04 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:04 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:04 user nova-compute[75233]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 (non-flash)
Dec 05 13:52:04 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:04 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f3461b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870'): ({'sde'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Removing single pathed devices sde {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3c73ac-a51a-4d02-97d9-b90f0507422f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b43988-4379-445f-a6fe-fa72fe560957]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Flushing IO for device /dev/sde {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb587eca-5d68-48b8-ac80-181541f1034c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a447133b-b7f4-4cfb-b3d0-c54b33ca2116]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[409350b9-124e-4ce0-b5eb-96fb4e952d50]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756db76-0254-4235-a014-af7a741209cd]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260]
Dec 05 13:52:04 user nova-compute[75233]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870, portal: 172.16.0.220,3260] successful.
Dec 05 13:52:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98a70fc-f8bf-435c-804e-54bafb5cf870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[647337a8-0536-4e70-aacd-dd2c519a3dff]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] <== disconnect_volume: return (387ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:52:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Deleting instance files /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2_del
Dec 05 13:52:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Deletion of /opt/stack/data/nova/instances/ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2_del complete
Dec 05 13:52:04 user nova-compute[75233]: INFO nova.compute.manager [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Took 1.38 seconds to destroy the instance on the hypervisor.
Dec 05 13:52:04 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:52:04 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:52:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:05 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:05 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Took 0.75 seconds to deallocate network for instance.
Dec 05 13:52:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-c60d3d05-59c8-4a18-8847-0cfc6444d641 req-8193de04-d3ee-447e-8da6-e345b2259d26 service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-deleted-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e141a8f-733e-4722-9aca-1b3b9404763b req-8efbe04f-4a45-4bb7-be04-dfd4277b1b4f service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e141a8f-733e-4722-9aca-1b3b9404763b req-8efbe04f-4a45-4bb7-be04-dfd4277b1b4f service nova] Acquiring lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e141a8f-733e-4722-9aca-1b3b9404763b req-8efbe04f-4a45-4bb7-be04-dfd4277b1b4f service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e141a8f-733e-4722-9aca-1b3b9404763b req-8efbe04f-4a45-4bb7-be04-dfd4277b1b4f service nova] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e141a8f-733e-4722-9aca-1b3b9404763b req-8efbe04f-4a45-4bb7-be04-dfd4277b1b4f service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] No waiting events found dispatching network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:06 user nova-compute[75233]: WARNING nova.compute.manager [req-4e141a8f-733e-4722-9aca-1b3b9404763b req-8efbe04f-4a45-4bb7-be04-dfd4277b1b4f service nova] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Received unexpected event network-vif-plugged-217ff3c3-5eed-435e-b7b1-ec6872e83d24 for instance with vm_state active and task_state deleting.
Dec 05 13:52:06 user nova-compute[75233]: INFO nova.compute.manager [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] [instance: ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2] Took 0.81 seconds to detach 1 volumes for instance.
Dec 05 13:52:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:52:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:06 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Deleted allocations for instance ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1fc599c2-0a0a-48d3-a0d9-c2b9c8e5eab6 tempest-ServerActionsTestOtherB-963894040 tempest-ServerActionsTestOtherB-963894040-project-member] Lock "ba6a6bb9-6cbf-4c25-bf7a-bc4fd701e9f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.534s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:52:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Creating image(s)
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Start _get_guest_xml network_info=[{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a83ef82d-ed7f-41e7-8666-f74b251c1ce2', 'attached_at': '', 'detached_at': '', 'volume_id': '4c688f24-405b-45d5-aaa3-25de31b3ce25', 'serial': '4c688f24-405b-45d5-aaa3-25de31b3ce25'}, 'delete_on_termination': True, 'attachment_id': '2ef18a84-255a-4a5b-928a-4e2b6378d7ef', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:52:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:52:07 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:52:07 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:52:07 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20a6746-83b0-4edb-804c-51fed01fa421]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:52:07 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f72ef03-2b65-4f51-8485-bff015ccc025]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25] added
Dec 05 13:52:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a383f4-f9d7-4474-aa72-05b1bb6fecac]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de4809-8d97-42bd-ae48-fe1bee3518a2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFxAJXsm {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFxAJXsm" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33a167b-9dc2-4959-82c8-0227ce319747]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFxAJXsm'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae88e4d-4416-495b-aaf6-5bdc3ec73069]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[035caa48-5def-47cb-9aff-8861d2e8cdb4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff8c55-f0cc-4305-bfce-cde0220659dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]
Dec 05 13:52:07 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.
Dec 05 13:52:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[edacb5c4-4fc0-4648-b9e8-660fea8bf7ac]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eb22b1-e282-46f2-b58c-20558916d3bb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e889416-fe95-4baa-905c-86f6651fa407]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:52:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23332333761396139', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332333761396139', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960902112',display_name='tempest-TestShelveInstance-server-1960902112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960902112',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqD6WhrnXmiRW6UXmwMGeYCxWEp54KSCoF1cUNUNvzuH88P8LyQoj5K8VQfPp0m0PFLPj8SpCtTo4oSUAkNjOiWhIJy65Ab7WVh2gX6etDGo/XvaGYSBT0ZUKHs8jGwg==',key_name='tempest-TestShelveInstance-2054970852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4ab64efbb5940c4a62331f4fce76a62',ramdisk_id='',reservation_id='r-j50rbkmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1187931716',owner_user_name='tempest-TestShelveInstance-1187931716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:51:57Z,user_data=None,user_id='a35a118fda664fe5a60df4a41ea7dc05',uuid=a83ef82d-ed7f-41e7-8666-f74b251c1ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converting VIF {"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'pci_devices' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:52:08 user nova-compute[75233]:   <uuid>a83ef82d-ed7f-41e7-8666-f74b251c1ce2</uuid>
Dec 05 13:52:08 user nova-compute[75233]:   <name>instance-0000001b</name>
Dec 05 13:52:08 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:52:08 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:52:08 user nova-compute[75233]:   <metadata>
Dec 05 13:52:08 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:52:08 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:52:08 user nova-compute[75233]:       <nova:name>tempest-TestShelveInstance-server-1960902112</nova:name>
Dec 05 13:52:08 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:52:07</nova:creationTime>
Dec 05 13:52:08 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:52:08 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:52:08 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:52:08 user nova-compute[75233]:       <nova:owner>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:user uuid="a35a118fda664fe5a60df4a41ea7dc05">tempest-TestShelveInstance-1187931716-project-member</nova:user>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:project uuid="c4ab64efbb5940c4a62331f4fce76a62">tempest-TestShelveInstance-1187931716</nova:project>
Dec 05 13:52:08 user nova-compute[75233]:       </nova:owner>
Dec 05 13:52:08 user nova-compute[75233]:       <nova:ports>
Dec 05 13:52:08 user nova-compute[75233]:         <nova:port uuid="49f84095-c600-4bd3-9e7f-12ef0ab68924">
Dec 05 13:52:08 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 13:52:08 user nova-compute[75233]:         </nova:port>
Dec 05 13:52:08 user nova-compute[75233]:       </nova:ports>
Dec 05 13:52:08 user nova-compute[75233]:     </nova:instance>
Dec 05 13:52:08 user nova-compute[75233]:   </metadata>
Dec 05 13:52:08 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:52:08 user nova-compute[75233]:     <system>
Dec 05 13:52:08 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:52:08 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:52:08 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:52:08 user nova-compute[75233]:       <entry name="serial">a83ef82d-ed7f-41e7-8666-f74b251c1ce2</entry>
Dec 05 13:52:08 user nova-compute[75233]:       <entry name="uuid">a83ef82d-ed7f-41e7-8666-f74b251c1ce2</entry>
Dec 05 13:52:08 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:52:08 user nova-compute[75233]:     </system>
Dec 05 13:52:08 user nova-compute[75233]:   </sysinfo>
Dec 05 13:52:08 user nova-compute[75233]:   <os>
Dec 05 13:52:08 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:52:08 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:52:08 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:52:08 user nova-compute[75233]:   </os>
Dec 05 13:52:08 user nova-compute[75233]:   <features>
Dec 05 13:52:08 user nova-compute[75233]:     <acpi/>
Dec 05 13:52:08 user nova-compute[75233]:     <apic/>
Dec 05 13:52:08 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:52:08 user nova-compute[75233]:   </features>
Dec 05 13:52:08 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:52:08 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:52:08 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:52:08 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:52:08 user nova-compute[75233]:   </clock>
Dec 05 13:52:08 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:52:08 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:52:08 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:52:08 user nova-compute[75233]:   </cpu>
Dec 05 13:52:08 user nova-compute[75233]:   <devices>
Dec 05 13:52:08 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:52:08 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:52:08 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 13:52:08 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:52:08 user nova-compute[75233]:       <serial>4c688f24-405b-45d5-aaa3-25de31b3ce25</serial>
Dec 05 13:52:08 user nova-compute[75233]:     </disk>
Dec 05 13:52:08 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:52:08 user nova-compute[75233]:       <mac address="fa:16:3e:e2:e5:50"/>
Dec 05 13:52:08 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:08 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:52:08 user nova-compute[75233]:       <target dev="tap49f84095-c6"/>
Dec 05 13:52:08 user nova-compute[75233]:     </interface>
Dec 05 13:52:08 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:52:08 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2/console.log" append="off"/>
Dec 05 13:52:08 user nova-compute[75233]:     </serial>
Dec 05 13:52:08 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:52:08 user nova-compute[75233]:     <video>
Dec 05 13:52:08 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:08 user nova-compute[75233]:     </video>
Dec 05 13:52:08 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:52:08 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:52:08 user nova-compute[75233]:     </rng>
Dec 05 13:52:08 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:52:08 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:52:08 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:52:08 user nova-compute[75233]:     </memballoon>
Dec 05 13:52:08 user nova-compute[75233]:   </devices>
Dec 05 13:52:08 user nova-compute[75233]: </domain>
Dec 05 13:52:08 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960902112',display_name='tempest-TestShelveInstance-server-1960902112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960902112',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqD6WhrnXmiRW6UXmwMGeYCxWEp54KSCoF1cUNUNvzuH88P8LyQoj5K8VQfPp0m0PFLPj8SpCtTo4oSUAkNjOiWhIJy65Ab7WVh2gX6etDGo/XvaGYSBT0ZUKHs8jGwg==',key_name='tempest-TestShelveInstance-2054970852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4ab64efbb5940c4a62331f4fce76a62',ramdisk_id='',reservation_id='r-j50rbkmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1187931716',owner_user_name='tempest-TestShelveInstance-1187931716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:51:57Z,user_data=None,user_id='a35a118fda664fe5a60df4a41ea7dc05',uuid=a83ef82d-ed7f-41e7-8666-f74b251c1ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converting VIF {"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG os_vif [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a1be18f-ea20-5628-b442-e8ee19687fd6', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49f84095-c6, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49f84095-c6, col_values=(('qos', UUID('50a8bbec-c53e-4f25-b59e-579652afab08')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49f84095-c6, col_values=(('external_ids', {'iface-id': '49f84095-c600-4bd3-9e7f-12ef0ab68924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e5:50', 'vm-uuid': 'a83ef82d-ed7f-41e7-8666-f74b251c1ce2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:08 user nova-compute[75233]: INFO os_vif [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6')
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:52:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] No VIF found with MAC fa:16:3e:e2:e5:50, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-d05c0b58-414e-4eb0-ae7a-48eedf4328f1 req-f1a9c9cf-e553-4539-94cf-382f367582ed service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d05c0b58-414e-4eb0-ae7a-48eedf4328f1 req-f1a9c9cf-e553-4539-94cf-382f367582ed service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d05c0b58-414e-4eb0-ae7a-48eedf4328f1 req-f1a9c9cf-e553-4539-94cf-382f367582ed service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d05c0b58-414e-4eb0-ae7a-48eedf4328f1 req-f1a9c9cf-e553-4539-94cf-382f367582ed service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-d05c0b58-414e-4eb0-ae7a-48eedf4328f1 req-f1a9c9cf-e553-4539-94cf-382f367582ed service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:10 user nova-compute[75233]: WARNING nova.compute.manager [req-d05c0b58-414e-4eb0-ae7a-48eedf4328f1 req-f1a9c9cf-e553-4539-94cf-382f367582ed service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state building and task_state spawning.
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:52:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance spawned successfully.
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:12 user nova-compute[75233]: INFO nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Took 4.90 seconds to spawn the instance on the hypervisor.
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:52:12 user nova-compute[75233]: INFO nova.compute.manager [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Took 15.63 seconds to build instance.
Dec 05 13:52:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-31347b31-a348-4010-bdc1-a7478a091190 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.754s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-09977446-b22f-40d5-9992-8215053c8008 req-ccbd7e2e-7750-462d-a244-3dfb9e9ecbce service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-09977446-b22f-40d5-9992-8215053c8008 req-ccbd7e2e-7750-462d-a244-3dfb9e9ecbce service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-09977446-b22f-40d5-9992-8215053c8008 req-ccbd7e2e-7750-462d-a244-3dfb9e9ecbce service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-09977446-b22f-40d5-9992-8215053c8008 req-ccbd7e2e-7750-462d-a244-3dfb9e9ecbce service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-09977446-b22f-40d5-9992-8215053c8008 req-ccbd7e2e-7750-462d-a244-3dfb9e9ecbce service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:12 user nova-compute[75233]: WARNING nova.compute.manager [req-09977446-b22f-40d5-9992-8215053c8008 req-ccbd7e2e-7750-462d-a244-3dfb9e9ecbce service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state active and task_state None.
Dec 05 13:52:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:18 user nova-compute[75233]: INFO nova.compute.manager [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Detaching volume 4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:52:18 user nova-compute[75233]: INFO nova.virt.block_device [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Attempting to driver detach volume 4152b2ea-a333-4d73-9fc1-81193949ecbe from mountpoint /dev/vdb
Dec 05 13:52:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Attempting to detach device vdb from instance 4f0cc131-8133-40a7-b331-6c87051b7646 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:52:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:52:18 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:52:18 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:52:18 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:52:18 user nova-compute[75233]:   <serial>4152b2ea-a333-4d73-9fc1-81193949ecbe</serial>
Dec 05 13:52:18 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:52:18 user nova-compute[75233]: </disk>
Dec 05 13:52:18 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:52:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully detached device vdb from instance 4f0cc131-8133-40a7-b331-6c87051b7646 from the persistent domain config.
Dec 05 13:52:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f0cc131-8133-40a7-b331-6c87051b7646 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:52:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:52:18 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:52:18 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:52:18 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:52:18 user nova-compute[75233]:   <serial>4152b2ea-a333-4d73-9fc1-81193949ecbe</serial>
Dec 05 13:52:18 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:52:18 user nova-compute[75233]: </disk>
Dec 05 13:52:18 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:52:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f0cc131-8133-40a7-b331-6c87051b7646 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:52:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG nova.network.neutron [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'info_cache' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:35 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.network.neutron [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance destroyed successfully.
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'resources' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG os_vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99da560f-01, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88f9de73-9fa3-44e4-82d7-7afccf2342cd) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:36 user nova-compute[75233]: INFO os_vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01')
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start _get_guest_xml network_info=[{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'numa_topology' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:36 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:36 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'pci_devices' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:52:36 user nova-compute[75233]:   <uuid>47d20f82-0294-43b9-97a3-7ae8c564d08d</uuid>
Dec 05 13:52:36 user nova-compute[75233]:   <name>instance-00000012</name>
Dec 05 13:52:36 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:52:36 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:52:36 user nova-compute[75233]:   <metadata>
Dec 05 13:52:36 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:52:36 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:52:36 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeTestJSON-server-460475358</nova:name>
Dec 05 13:52:36 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:52:36</nova:creationTime>
Dec 05 13:52:36 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:52:36 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:52:36 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:52:36 user nova-compute[75233]:       <nova:owner>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:user uuid="a6a3445087d842fc9279e2472759bf1f">tempest-AttachVolumeTestJSON-1807043870-project-member</nova:user>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:project uuid="14235050c7d84ebb8ff12ff245c35fec">tempest-AttachVolumeTestJSON-1807043870</nova:project>
Dec 05 13:52:36 user nova-compute[75233]:       </nova:owner>
Dec 05 13:52:36 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:52:36 user nova-compute[75233]:       <nova:ports>
Dec 05 13:52:36 user nova-compute[75233]:         <nova:port uuid="99da560f-01fc-4f4c-81f8-7d3a72dc8d45">
Dec 05 13:52:36 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 13:52:36 user nova-compute[75233]:         </nova:port>
Dec 05 13:52:36 user nova-compute[75233]:       </nova:ports>
Dec 05 13:52:36 user nova-compute[75233]:     </nova:instance>
Dec 05 13:52:36 user nova-compute[75233]:   </metadata>
Dec 05 13:52:36 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:52:36 user nova-compute[75233]:     <system>
Dec 05 13:52:36 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:52:36 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:52:36 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:52:36 user nova-compute[75233]:       <entry name="serial">47d20f82-0294-43b9-97a3-7ae8c564d08d</entry>
Dec 05 13:52:36 user nova-compute[75233]:       <entry name="uuid">47d20f82-0294-43b9-97a3-7ae8c564d08d</entry>
Dec 05 13:52:36 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:52:36 user nova-compute[75233]:     </system>
Dec 05 13:52:36 user nova-compute[75233]:   </sysinfo>
Dec 05 13:52:36 user nova-compute[75233]:   <os>
Dec 05 13:52:36 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:52:36 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:52:36 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:52:36 user nova-compute[75233]:   </os>
Dec 05 13:52:36 user nova-compute[75233]:   <features>
Dec 05 13:52:36 user nova-compute[75233]:     <acpi/>
Dec 05 13:52:36 user nova-compute[75233]:     <apic/>
Dec 05 13:52:36 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:52:36 user nova-compute[75233]:   </features>
Dec 05 13:52:36 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:52:36 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:52:36 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:52:36 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:52:36 user nova-compute[75233]:   </clock>
Dec 05 13:52:36 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:52:36 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:52:36 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:52:36 user nova-compute[75233]:   </cpu>
Dec 05 13:52:36 user nova-compute[75233]:   <devices>
Dec 05 13:52:36 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:52:36 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:52:36 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk"/>
Dec 05 13:52:36 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:52:36 user nova-compute[75233]:     </disk>
Dec 05 13:52:36 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:52:36 user nova-compute[75233]:       <mac address="fa:16:3e:d5:3a:57"/>
Dec 05 13:52:36 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:36 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:52:36 user nova-compute[75233]:       <target dev="tap99da560f-01"/>
Dec 05 13:52:36 user nova-compute[75233]:     </interface>
Dec 05 13:52:36 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:52:36 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/console.log" append="off"/>
Dec 05 13:52:36 user nova-compute[75233]:     </serial>
Dec 05 13:52:36 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:52:36 user nova-compute[75233]:     <video>
Dec 05 13:52:36 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:36 user nova-compute[75233]:     </video>
Dec 05 13:52:36 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:52:36 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:52:36 user nova-compute[75233]:     </rng>
Dec 05 13:52:36 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:52:36 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:52:36 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:52:36 user nova-compute[75233]:     </memballoon>
Dec 05 13:52:36 user nova-compute[75233]:   </devices>
Dec 05 13:52:36 user nova-compute[75233]: </domain>
Dec 05 13:52:36 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:52:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Cannot resize image /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'migration_context' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG nova.objects.base [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Object Instance<47d20f82-0294-43b9-97a3-7ae8c564d08d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG os_vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c21130e1-59cf-58e9-9a14-1dd30573fb0a', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99da560f-01, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99da560f-01, col_values=(('qos', UUID('6f0690a5-b55b-46a6-af62-e871c23f3ae6')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99da560f-01, col_values=(('external_ids', {'iface-id': '99da560f-01fc-4f4c-81f8-7d3a72dc8d45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:3a:57', 'vm-uuid': '47d20f82-0294-43b9-97a3-7ae8c564d08d'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:37 user nova-compute[75233]: INFO os_vif [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01')
Dec 05 13:52:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f0cc131-8133-40a7-b331-6c87051b7646 is timed out.
Dec 05 13:52:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully detached device vdb from instance 4f0cc131-8133-40a7-b331-6c87051b7646 from the live domain config.
Dec 05 13:52:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aBhcJVYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:52:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:52:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3288162-1863-44ff-9c6e-2c2058fa13af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:52:38 user nova-compute[75233]: No targets found.
Dec 05 13:52:38 user nova-compute[75233]: iSNS:
Dec 05 13:52:38 user nova-compute[75233]: No targets found.
Dec 05 13:52:38 user nova-compute[75233]: STATIC:
Dec 05 13:52:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:52:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:52:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe
Dec 05 13:52:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:52:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:52:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:52:38 user nova-compute[75233]: FIRMWARE:
Dec 05 13:52:38 user nova-compute[75233]: No targets found.
Dec 05 13:52:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:52:38 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:52:38 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de24e4e-d70e-41fd-9eff-df2776cb67a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb5e69-ebdf-40f2-91d9-98db654c4d10]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:39 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:39 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:39 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:39 user nova-compute[75233]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe (non-flash)
Dec 05 13:52:39 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:39 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582ae440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe'): ({'sdf'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Removing single pathed devices sdf {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3176cf-ef6f-47a2-9bc9-ddcba1fd551d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[09848108-4577-4a74-b507-a0f3b1f168a7]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flushing IO for device /dev/sdf {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e27ac79-83d7-4684-919b-54dc8c97d02d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3980bfc5-56eb-44b0-9071-319e5a0a3383]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21db66f-3f44-4766-82f7-42c480846182]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:52:39 user nova-compute[75233]: INFO nova.compute.claims [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Claim successful on node user
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ce353-2197-412a-935e-12008fe23e1e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260]
Dec 05 13:52:39 user nova-compute[75233]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe, portal: 172.16.0.220,3260] successful.
Dec 05 13:52:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152b2ea-a333-4d73-9fc1-81193949ecbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[845afa28-f006-4e02-81e7-5abbf6874f60]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== disconnect_volume: return (337ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:52:39 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:52:39 user nova-compute[75233]: DEBUG nova.policy [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df61cbca359144e4a0c9ce81b51ebcee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd04a994cbca48239afebd5080f31725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:52:39 user nova-compute[75233]: INFO nova.virt.block_device [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Booting with blank volume at /dev/vda
Dec 05 13:52:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid 4f0cc131-8133-40a7-b331-6c87051b7646 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4e2353e5-1a9b-4512-bf37-fecc0f862e5b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Successfully created port: 8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:52:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance rebooted successfully.
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-93698f5a-545c-478b-9b3d-6c7608f0f9ef tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-a68aacdb-b57a-452b-84f4-5c401072467b req-720fd6a5-8504-4934-9c62-d00992e258ff service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a68aacdb-b57a-452b-84f4-5c401072467b req-720fd6a5-8504-4934-9c62-d00992e258ff service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a68aacdb-b57a-452b-84f4-5c401072467b req-720fd6a5-8504-4934-9c62-d00992e258ff service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a68aacdb-b57a-452b-84f4-5c401072467b req-720fd6a5-8504-4934-9c62-d00992e258ff service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-a68aacdb-b57a-452b-84f4-5c401072467b req-720fd6a5-8504-4934-9c62-d00992e258ff service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:40 user nova-compute[75233]: WARNING nova.compute.manager [req-a68aacdb-b57a-452b-84f4-5c401072467b req-720fd6a5-8504-4934-9c62-d00992e258ff service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state active and task_state None.
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:52:41 user nova-compute[75233]: INFO nova.compute.claims [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Claim successful on node user
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Successfully updated port: 8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-changed-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Refreshing instance network info cache due to event network-changed-8cc45a19-cc12-4332-8254-0d66824372ad. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:52:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance network_info: |[{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.network.neutron [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Refreshing network info cache for port 8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.policy [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18b742f965294f9cb81174161e2b0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5ca89f82f548b3b6a23c5f56a65051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:52:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Creating image(s)
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "/opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "/opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updated VIF entry in instance network info cache for port 8cc45a19-cc12-4332-8254-0d66824372ad. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a67180d3-abee-42a3-9649-ca8e3efc725d req-5cbf26fe-40f3-441e-a0d7-3094c14a30d1 service nova] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk 1073741824" returned: 0 in 0.053s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Successfully created port: c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.210s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Cannot resize image /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-58be33fd-f01d-48e4-bc2c-7d93151c1b61 req-7c7330fe-fd4a-4339-935a-bb42f6a463cb service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-58be33fd-f01d-48e4-bc2c-7d93151c1b61 req-7c7330fe-fd4a-4339-935a-bb42f6a463cb service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-58be33fd-f01d-48e4-bc2c-7d93151c1b61 req-7c7330fe-fd4a-4339-935a-bb42f6a463cb service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-58be33fd-f01d-48e4-bc2c-7d93151c1b61 req-7c7330fe-fd4a-4339-935a-bb42f6a463cb service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-58be33fd-f01d-48e4-bc2c-7d93151c1b61 req-7c7330fe-fd4a-4339-935a-bb42f6a463cb service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:42 user nova-compute[75233]: WARNING nova.compute.manager [req-58be33fd-f01d-48e4-bc2c-7d93151c1b61 req-7c7330fe-fd4a-4339-935a-bb42f6a463cb service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state active and task_state None.
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Successfully updated port: c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquired lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-changed-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Refreshing instance network info cache due to event network-changed-c51e2cb3-79fc-4a6d-affb-24652036b3cc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] Acquiring lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating instance_info_cache with network_info: [{"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Releasing lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Instance network_info: |[{"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] Acquired lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Refreshing network info cache for port c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Start _get_guest_xml network_info=[{"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:52:43 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:43 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-84227660',display_name='tempest-SnapshotDataIntegrityTests-server-84227660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-84227660',id=29,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyQmHBSLKw2U+MhyRP67gsK0Go2JajBCsKIzNkcJRPFLJo+LmkkGB0VWaBSfhVqvc7gbQfrTZSmS5RZECRaxaVYmPIWogPWQuGFwBbIxSNBzxnqNpzkJpxxlaCstj6tew==',key_name='tempest-keypair-2070929162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd5ca89f82f548b3b6a23c5f56a65051',ramdisk_id='',reservation_id='r-nmlctw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1595189290',owner_user_name='tempest-SnapshotDataIntegrityTests-1595189290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18b742f965294f9cb81174161e2b0764',uuid=a4f836f8-55ae-46c1-8b66-31fb61d06b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Converting VIF {"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'pci_devices' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:52:43 user nova-compute[75233]:   <uuid>a4f836f8-55ae-46c1-8b66-31fb61d06b3e</uuid>
Dec 05 13:52:43 user nova-compute[75233]:   <name>instance-0000001d</name>
Dec 05 13:52:43 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:52:43 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:52:43 user nova-compute[75233]:   <metadata>
Dec 05 13:52:43 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:52:43 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:52:43 user nova-compute[75233]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-84227660</nova:name>
Dec 05 13:52:43 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:52:43</nova:creationTime>
Dec 05 13:52:43 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:52:43 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:52:43 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:52:43 user nova-compute[75233]:       <nova:owner>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:user uuid="18b742f965294f9cb81174161e2b0764">tempest-SnapshotDataIntegrityTests-1595189290-project-member</nova:user>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:project uuid="bd5ca89f82f548b3b6a23c5f56a65051">tempest-SnapshotDataIntegrityTests-1595189290</nova:project>
Dec 05 13:52:43 user nova-compute[75233]:       </nova:owner>
Dec 05 13:52:43 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:52:43 user nova-compute[75233]:       <nova:ports>
Dec 05 13:52:43 user nova-compute[75233]:         <nova:port uuid="c51e2cb3-79fc-4a6d-affb-24652036b3cc">
Dec 05 13:52:43 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 13:52:43 user nova-compute[75233]:         </nova:port>
Dec 05 13:52:43 user nova-compute[75233]:       </nova:ports>
Dec 05 13:52:43 user nova-compute[75233]:     </nova:instance>
Dec 05 13:52:43 user nova-compute[75233]:   </metadata>
Dec 05 13:52:43 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:52:43 user nova-compute[75233]:     <system>
Dec 05 13:52:43 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:52:43 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:52:43 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:52:43 user nova-compute[75233]:       <entry name="serial">a4f836f8-55ae-46c1-8b66-31fb61d06b3e</entry>
Dec 05 13:52:43 user nova-compute[75233]:       <entry name="uuid">a4f836f8-55ae-46c1-8b66-31fb61d06b3e</entry>
Dec 05 13:52:43 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:52:43 user nova-compute[75233]:     </system>
Dec 05 13:52:43 user nova-compute[75233]:   </sysinfo>
Dec 05 13:52:43 user nova-compute[75233]:   <os>
Dec 05 13:52:43 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:52:43 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:52:43 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:52:43 user nova-compute[75233]:   </os>
Dec 05 13:52:43 user nova-compute[75233]:   <features>
Dec 05 13:52:43 user nova-compute[75233]:     <acpi/>
Dec 05 13:52:43 user nova-compute[75233]:     <apic/>
Dec 05 13:52:43 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:52:43 user nova-compute[75233]:   </features>
Dec 05 13:52:43 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:52:43 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:52:43 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:52:43 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:52:43 user nova-compute[75233]:   </clock>
Dec 05 13:52:43 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:52:43 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:52:43 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:52:43 user nova-compute[75233]:   </cpu>
Dec 05 13:52:43 user nova-compute[75233]:   <devices>
Dec 05 13:52:43 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:52:43 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:52:43 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk"/>
Dec 05 13:52:43 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:52:43 user nova-compute[75233]:     </disk>
Dec 05 13:52:43 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:52:43 user nova-compute[75233]:       <mac address="fa:16:3e:5b:80:e7"/>
Dec 05 13:52:43 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:43 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:52:43 user nova-compute[75233]:       <target dev="tapc51e2cb3-79"/>
Dec 05 13:52:43 user nova-compute[75233]:     </interface>
Dec 05 13:52:43 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:52:43 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/console.log" append="off"/>
Dec 05 13:52:43 user nova-compute[75233]:     </serial>
Dec 05 13:52:43 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:52:43 user nova-compute[75233]:     <video>
Dec 05 13:52:43 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:43 user nova-compute[75233]:     </video>
Dec 05 13:52:43 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:52:43 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:52:43 user nova-compute[75233]:     </rng>
Dec 05 13:52:43 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:52:43 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:52:43 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:52:43 user nova-compute[75233]:     </memballoon>
Dec 05 13:52:43 user nova-compute[75233]:   </devices>
Dec 05 13:52:43 user nova-compute[75233]: </domain>
Dec 05 13:52:43 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-84227660',display_name='tempest-SnapshotDataIntegrityTests-server-84227660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-84227660',id=29,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyQmHBSLKw2U+MhyRP67gsK0Go2JajBCsKIzNkcJRPFLJo+LmkkGB0VWaBSfhVqvc7gbQfrTZSmS5RZECRaxaVYmPIWogPWQuGFwBbIxSNBzxnqNpzkJpxxlaCstj6tew==',key_name='tempest-keypair-2070929162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd5ca89f82f548b3b6a23c5f56a65051',ramdisk_id='',reservation_id='r-nmlctw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1595189290',owner_user_name='tempest-SnapshotDataIntegrityTests-1595189290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18b742f965294f9cb81174161e2b0764',uuid=a4f836f8-55ae-46c1-8b66-31fb61d06b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Converting VIF {"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG os_vif [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c51a7278-6083-58fd-a36d-7c93e5010af5', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc51e2cb3-79, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc51e2cb3-79, col_values=(('qos', UUID('5989e8a1-85a9-48e3-965c-7f4760c33722')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc51e2cb3-79, col_values=(('external_ids', {'iface-id': 'c51e2cb3-79fc-4a6d-affb-24652036b3cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:80:e7', 'vm-uuid': 'a4f836f8-55ae-46c1-8b66-31fb61d06b3e'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:43 user nova-compute[75233]: INFO os_vif [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79')
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No VIF found with MAC fa:16:3e:5b:80:e7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updated VIF entry in instance network info cache for port c51e2cb3-79fc-4a6d-affb-24652036b3cc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating instance_info_cache with network_info: [{"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:52:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c16de45-b013-4fea-b7b5-8da79fcd7a1d req-a44850b9-e72f-4fa4-8f0b-e7987a773a0d service nova] Releasing lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:52:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-71e45d31-a234-45d2-b9ae-fcea5470d1c8 req-1b82814c-3ef7-4073-97f2-0736afc03896 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-71e45d31-a234-45d2-b9ae-fcea5470d1c8 req-1b82814c-3ef7-4073-97f2-0736afc03896 service nova] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-71e45d31-a234-45d2-b9ae-fcea5470d1c8 req-1b82814c-3ef7-4073-97f2-0736afc03896 service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-71e45d31-a234-45d2-b9ae-fcea5470d1c8 req-1b82814c-3ef7-4073-97f2-0736afc03896 service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-71e45d31-a234-45d2-b9ae-fcea5470d1c8 req-1b82814c-3ef7-4073-97f2-0736afc03896 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] No waiting events found dispatching network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:45 user nova-compute[75233]: WARNING nova.compute.manager [req-71e45d31-a234-45d2-b9ae-fcea5470d1c8 req-1b82814c-3ef7-4073-97f2-0736afc03896 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received unexpected event network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc for instance with vm_state building and task_state spawning.
Dec 05 13:52:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG os_brick.utils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[249311c1-bcc5-4017-b81c-3e6539cf99b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df233217-230b-441e-82e5-0347bbec3e94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea905c-291f-4057-93e5-b642c643661c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f9353-c3ba-41cc-a795-5551a3e2f1e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:52:45 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:52:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb1cf76-8d40-450b-b0a8-39a402a72e11]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG os_brick.utils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:52:45 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating existing volume attachment record: 917835a1-9c41-4881-a11e-37d551beb4da {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-749c534e-dbf5-4c96-9a0f-24bbce26c1fc req-e0782ff6-4764-41b2-b50a-39465965f1ee service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-749c534e-dbf5-4c96-9a0f-24bbce26c1fc req-e0782ff6-4764-41b2-b50a-39465965f1ee service nova] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-749c534e-dbf5-4c96-9a0f-24bbce26c1fc req-e0782ff6-4764-41b2-b50a-39465965f1ee service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-749c534e-dbf5-4c96-9a0f-24bbce26c1fc req-e0782ff6-4764-41b2-b50a-39465965f1ee service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-749c534e-dbf5-4c96-9a0f-24bbce26c1fc req-e0782ff6-4764-41b2-b50a-39465965f1ee service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] No waiting events found dispatching network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:47 user nova-compute[75233]: WARNING nova.compute.manager [req-749c534e-dbf5-4c96-9a0f-24bbce26c1fc req-e0782ff6-4764-41b2-b50a-39465965f1ee service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received unexpected event network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc for instance with vm_state building and task_state spawning.
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:52:47 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Instance spawned successfully.
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:52:47 user nova-compute[75233]: INFO nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Took 5.62 seconds to spawn the instance on the hypervisor.
Dec 05 13:52:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:52:47 user nova-compute[75233]: INFO nova.compute.manager [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Took 6.47 seconds to build instance.
Dec 05 13:52:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f2a09856-84b1-4c6e-aac8-f86f087badbf tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:55 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7676MB free_disk=25.083141326904297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b4b42e4d-f5e2-48ec-842a-536a1f250585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 4f0cc131-8133-40a7-b331-6c87051b7646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance fba66d11-7258-45dd-9d43-d6243d334d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a83ef82d-ed7f-41e7-8666-f74b251c1ce2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:52:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Creating image(s)
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Ensure instance console log exists: /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Start _get_guest_xml network_info=[{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab4d6587-2b04-46f7-9756-223a264a3efa', 'attached_at': '', 'detached_at': '', 'volume_id': '3095420e-8025-40c7-9c5e-b89c102e03ac', 'serial': '3095420e-8025-40c7-9c5e-b89c102e03ac'}, 'delete_on_termination': False, 'attachment_id': '917835a1-9c41-4881-a11e-37d551beb4da', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:52:55 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:55 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:52:55 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:52:55 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:52:55 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f921ca1c-888d-489d-854d-13a495978192]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:52:55 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d269cabf-605a-492b-9556-32e05c0bfdc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac] added
Dec 05 13:52:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdfb88e-4c65-4cd0-aee8-7649577f109f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68bd7a7-dcd4-41bf-99f6-2767cb3414cd]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKItQhbc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKItQhbc" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65cd9a-aac7-4bad-a8e8-9d608d8c132b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKItQhbc'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a419b08-25e8-4721-bd93-bccd15460bed]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc11221-315c-43eb-92bc-29167d95a089]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee89b45-3163-4cf7-a091-f8a7045b6893]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260]
Dec 05 13:52:55 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260] successful.
Dec 05 13:52:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18394b5-3669-4885-a78f-16a910372ab0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8bf98-b7e1-4341-8fe4-b10b47a7ce5a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:52:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:52:55 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:52:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:52:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b8b36-9f13-446c-9aee-24e738266f4d]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:52:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23765346161653436', 'path': '/dev/sde'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765346161653436', 'path': '/dev/sde'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1556427376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1556427376',id=28,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-4tgm05pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:52:40Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=ab4d6587-2b04-46f7-9756-223a264a3efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'pci_devices' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:52:57 user nova-compute[75233]:   <uuid>ab4d6587-2b04-46f7-9756-223a264a3efa</uuid>
Dec 05 13:52:57 user nova-compute[75233]:   <name>instance-0000001c</name>
Dec 05 13:52:57 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:52:57 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:52:57 user nova-compute[75233]:   <metadata>
Dec 05 13:52:57 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:52:57 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:52:57 user nova-compute[75233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1556427376</nova:name>
Dec 05 13:52:57 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:52:55</nova:creationTime>
Dec 05 13:52:57 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:52:57 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:52:57 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:52:57 user nova-compute[75233]:       <nova:owner>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:user uuid="df61cbca359144e4a0c9ce81b51ebcee">tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member</nova:user>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:project uuid="bd04a994cbca48239afebd5080f31725">tempest-ServerBootFromVolumeStableRescueTest-264323439</nova:project>
Dec 05 13:52:57 user nova-compute[75233]:       </nova:owner>
Dec 05 13:52:57 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:52:57 user nova-compute[75233]:       <nova:ports>
Dec 05 13:52:57 user nova-compute[75233]:         <nova:port uuid="8cc45a19-cc12-4332-8254-0d66824372ad">
Dec 05 13:52:57 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:52:57 user nova-compute[75233]:         </nova:port>
Dec 05 13:52:57 user nova-compute[75233]:       </nova:ports>
Dec 05 13:52:57 user nova-compute[75233]:     </nova:instance>
Dec 05 13:52:57 user nova-compute[75233]:   </metadata>
Dec 05 13:52:57 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:52:57 user nova-compute[75233]:     <system>
Dec 05 13:52:57 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:52:57 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:52:57 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:52:57 user nova-compute[75233]:       <entry name="serial">ab4d6587-2b04-46f7-9756-223a264a3efa</entry>
Dec 05 13:52:57 user nova-compute[75233]:       <entry name="uuid">ab4d6587-2b04-46f7-9756-223a264a3efa</entry>
Dec 05 13:52:57 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:52:57 user nova-compute[75233]:     </system>
Dec 05 13:52:57 user nova-compute[75233]:   </sysinfo>
Dec 05 13:52:57 user nova-compute[75233]:   <os>
Dec 05 13:52:57 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:52:57 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:52:57 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:52:57 user nova-compute[75233]:   </os>
Dec 05 13:52:57 user nova-compute[75233]:   <features>
Dec 05 13:52:57 user nova-compute[75233]:     <acpi/>
Dec 05 13:52:57 user nova-compute[75233]:     <apic/>
Dec 05 13:52:57 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:52:57 user nova-compute[75233]:   </features>
Dec 05 13:52:57 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:52:57 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:52:57 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:52:57 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:52:57 user nova-compute[75233]:   </clock>
Dec 05 13:52:57 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:52:57 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:52:57 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:52:57 user nova-compute[75233]:   </cpu>
Dec 05 13:52:57 user nova-compute[75233]:   <devices>
Dec 05 13:52:57 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:52:57 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:52:57 user nova-compute[75233]:       <source dev="/dev/sde"/>
Dec 05 13:52:57 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:52:57 user nova-compute[75233]:       <serial>3095420e-8025-40c7-9c5e-b89c102e03ac</serial>
Dec 05 13:52:57 user nova-compute[75233]:     </disk>
Dec 05 13:52:57 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:52:57 user nova-compute[75233]:       <mac address="fa:16:3e:05:09:96"/>
Dec 05 13:52:57 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:57 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:52:57 user nova-compute[75233]:       <target dev="tap8cc45a19-cc"/>
Dec 05 13:52:57 user nova-compute[75233]:     </interface>
Dec 05 13:52:57 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:52:57 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/console.log" append="off"/>
Dec 05 13:52:57 user nova-compute[75233]:     </serial>
Dec 05 13:52:57 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:52:57 user nova-compute[75233]:     <video>
Dec 05 13:52:57 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:52:57 user nova-compute[75233]:     </video>
Dec 05 13:52:57 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:52:57 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:52:57 user nova-compute[75233]:     </rng>
Dec 05 13:52:57 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:52:57 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:52:57 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:52:57 user nova-compute[75233]:     </memballoon>
Dec 05 13:52:57 user nova-compute[75233]:   </devices>
Dec 05 13:52:57 user nova-compute[75233]: </domain>
Dec 05 13:52:57 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1556427376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1556427376',id=28,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-4tgm05pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:52:40Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=ab4d6587-2b04-46f7-9756-223a264a3efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG os_vif [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2fac5c4-0d86-5515-8c97-7f83bfde8a7d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cc45a19-cc, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cc45a19-cc, col_values=(('qos', UUID('e6b6d85a-8d50-4739-a730-79adac4973bc')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cc45a19-cc, col_values=(('external_ids', {'iface-id': '8cc45a19-cc12-4332-8254-0d66824372ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:09:96', 'vm-uuid': 'ab4d6587-2b04-46f7-9756-223a264a3efa'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:57 user nova-compute[75233]: INFO os_vif [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc')
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:52:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No VIF found with MAC fa:16:3e:05:09:96, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-97b9ec08-e47d-4bfa-8d8d-fc39ebb5f872 req-922d7b76-09e8-4b29-9dc0-46b4b46ced4a service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-97b9ec08-e47d-4bfa-8d8d-fc39ebb5f872 req-922d7b76-09e8-4b29-9dc0-46b4b46ced4a service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-97b9ec08-e47d-4bfa-8d8d-fc39ebb5f872 req-922d7b76-09e8-4b29-9dc0-46b4b46ced4a service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-97b9ec08-e47d-4bfa-8d8d-fc39ebb5f872 req-922d7b76-09e8-4b29-9dc0-46b4b46ced4a service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:52:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-97b9ec08-e47d-4bfa-8d8d-fc39ebb5f872 req-922d7b76-09e8-4b29-9dc0-46b4b46ced4a service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:52:58 user nova-compute[75233]: WARNING nova.compute.manager [req-97b9ec08-e47d-4bfa-8d8d-fc39ebb5f872 req-922d7b76-09e8-4b29-9dc0-46b4b46ced4a service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state building and task_state spawning.
Dec 05 13:52:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:52:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:52:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing instance network info cache due to event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:52:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:52:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:52:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.network.neutron [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updated VIF entry in instance network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.network.neutron [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8cad2a32-f09e-4f79-b934-9a9773c775fe req-6350f160-315a-40ae-9c11-2c5a2ffd896b service nova] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.compute.manager [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Detaching volume 8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.virt.block_device [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Attempting to driver detach volume 8e519c9a-cc14-47bf-a26a-acc1dae0d966 from mountpoint /dev/vdb
Dec 05 13:53:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Attempting to detach device vdb from instance b4b42e4d-f5e2-48ec-842a-536a1f250585 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:53:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:53:00 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:53:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:53:00 user nova-compute[75233]:   <serial>8e519c9a-cc14-47bf-a26a-acc1dae0d966</serial>
Dec 05 13:53:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:53:00 user nova-compute[75233]: </disk>
Dec 05 13:53:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully detached device vdb from instance b4b42e4d-f5e2-48ec-842a-536a1f250585 from the persistent domain config.
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4b42e4d-f5e2-48ec-842a-536a1f250585 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:53:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:53:00 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 13:53:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:53:00 user nova-compute[75233]:   <serial>8e519c9a-cc14-47bf-a26a-acc1dae0d966</serial>
Dec 05 13:53:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:53:00 user nova-compute[75233]: </disk>
Dec 05 13:53:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.compute.manager [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Detaching volume 38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.virt.block_device [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Attempting to driver detach volume 38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 from mountpoint /dev/vdb
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Attempting to detach device vdb from instance fba66d11-7258-45dd-9d43-d6243d334d16 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:53:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:53:00 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:53:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:53:00 user nova-compute[75233]:   <serial>38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3</serial>
Dec 05 13:53:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 13:53:00 user nova-compute[75233]: </disk>
Dec 05 13:53:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully detached device vdb from instance fba66d11-7258-45dd-9d43-d6243d334d16 from the persistent domain config.
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fba66d11-7258-45dd-9d43-d6243d334d16 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:53:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:53:00 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:53:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:53:00 user nova-compute[75233]:   <serial>38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3</serial>
Dec 05 13:53:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 13:53:00 user nova-compute[75233]: </disk>
Dec 05 13:53:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-33b56dfa-b7d2-478e-8c1f-1bf396d3084b req-d249faee-bfe9-4607-8613-d42432cb16f1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-33b56dfa-b7d2-478e-8c1f-1bf396d3084b req-d249faee-bfe9-4607-8613-d42432cb16f1 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-33b56dfa-b7d2-478e-8c1f-1bf396d3084b req-d249faee-bfe9-4607-8613-d42432cb16f1 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-33b56dfa-b7d2-478e-8c1f-1bf396d3084b req-d249faee-bfe9-4607-8613-d42432cb16f1 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-33b56dfa-b7d2-478e-8c1f-1bf396d3084b req-d249faee-bfe9-4607-8613-d42432cb16f1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:00 user nova-compute[75233]: WARNING nova.compute.manager [req-33b56dfa-b7d2-478e-8c1f-1bf396d3084b req-d249faee-bfe9-4607-8613-d42432cb16f1 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state building and task_state spawning.
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance spawned successfully.
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:53:00 user nova-compute[75233]: INFO nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Took 5.30 seconds to spawn the instance on the hypervisor.
Dec 05 13:53:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:53:01 user nova-compute[75233]: INFO nova.compute.manager [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Took 21.87 seconds to build instance.
Dec 05 13:53:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d25f5225-d0a3-43c9-af4f-30dbe4b3e9b9 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.973s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing instance network info cache due to event network-changed-1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] Acquiring lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] Acquired lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG nova.network.neutron [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Refreshing network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:01 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG nova.network.neutron [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updated VIF entry in instance network info cache for port 1405dadf-e129-4a04-b5e2-ef49395ebcdd. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG nova.network.neutron [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [{"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-3024207a-e42a-4bb5-a6c1-3b5b8fa5a7e5 req-2edb0d19-20c7-4262-a5a7-b37e5cac0ba5 service nova] Releasing lock "refresh_cache-b4b42e4d-f5e2-48ec-842a-536a1f250585" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:53:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:08 user nova-compute[75233]: INFO nova.compute.manager [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Terminating instance
Dec 05 13:53:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-675fd477-f1f4-4a54-972f-b03d607210dd req-c90f5d93-1b19-4a32-992d-9beba33e9f2f service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-vif-unplugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-675fd477-f1f4-4a54-972f-b03d607210dd req-c90f5d93-1b19-4a32-992d-9beba33e9f2f service nova] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-675fd477-f1f4-4a54-972f-b03d607210dd req-c90f5d93-1b19-4a32-992d-9beba33e9f2f service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-675fd477-f1f4-4a54-972f-b03d607210dd req-c90f5d93-1b19-4a32-992d-9beba33e9f2f service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-675fd477-f1f4-4a54-972f-b03d607210dd req-c90f5d93-1b19-4a32-992d-9beba33e9f2f service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] No waiting events found dispatching network-vif-unplugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-675fd477-f1f4-4a54-972f-b03d607210dd req-c90f5d93-1b19-4a32-992d-9beba33e9f2f service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-vif-unplugged-6009ab44-d20d-46bc-9847-842362dc8fe2 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:53:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Instance destroyed successfully.
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'resources' on Instance uuid 4f0cc131-8133-40a7-b331-6c87051b7646 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1745423441',display_name='tempest-AttachVolumeNegativeTest-server-1745423441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1745423441',id=22,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVyKJGS316z0C76qky3S9HV3ErW3BnVl5Vx46xepI5YB7fGPHQ85xhORI64DAJpGRyzEDR3uvwcL0w1rL6AsexM0h8uG8CYqU/UEgtSkSQ4ZrtORcnyxUNnTGdKqhmb9w==',key_name='tempest-keypair-1468679495',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:47:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-kgkq41o5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=4f0cc131-8133-40a7-b331-6c87051b7646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "6009ab44-d20d-46bc-9847-842362dc8fe2", "address": "fa:16:3e:e9:f0:34", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6009ab44-d2", "ovs_interfaceid": "6009ab44-d20d-46bc-9847-842362dc8fe2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG os_vif [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6009ab44-d2, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb558a18-f257-4f21-92ef-ee89d131edb2) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:09 user nova-compute[75233]: INFO os_vif [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:f0:34,bridge_name='br-int',has_traffic_filtering=True,id=6009ab44-d20d-46bc-9847-842362dc8fe2,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6009ab44-d2')
Dec 05 13:53:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Deleting instance files /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646_del
Dec 05 13:53:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Deletion of /opt/stack/data/nova/instances/4f0cc131-8133-40a7-b331-6c87051b7646_del complete
Dec 05 13:53:09 user nova-compute[75233]: INFO nova.compute.manager [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 05 13:53:09 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:53:09 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:53:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:10 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:10 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Took 1.29 seconds to deallocate network for instance.
Dec 05 13:53:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-909f7190-1ebd-4c1a-abef-ceddce669c9c req-448c119c-e52e-46f6-867e-c7ef93aaa745 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-vif-deleted-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:10 user nova-compute[75233]: INFO nova.compute.manager [req-909f7190-1ebd-4c1a-abef-ceddce669c9c req-448c119c-e52e-46f6-867e-c7ef93aaa745 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Neutron deleted interface 6009ab44-d20d-46bc-9847-842362dc8fe2; detaching it from the instance and deleting it from the info cache
Dec 05 13:53:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-909f7190-1ebd-4c1a-abef-ceddce669c9c req-448c119c-e52e-46f6-867e-c7ef93aaa745 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-909f7190-1ebd-4c1a-abef-ceddce669c9c req-448c119c-e52e-46f6-867e-c7ef93aaa745 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Detach interface failed, port_id=6009ab44-d20d-46bc-9847-842362dc8fe2, reason: Instance 4f0cc131-8133-40a7-b331-6c87051b7646 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-8c640f06-5eac-4ff2-8768-c781f58dad62 req-5b95c665-f15a-4461-a49e-22377ee7fa98 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received event network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c640f06-5eac-4ff2-8768-c781f58dad62 req-5b95c665-f15a-4461-a49e-22377ee7fa98 service nova] Acquiring lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c640f06-5eac-4ff2-8768-c781f58dad62 req-5b95c665-f15a-4461-a49e-22377ee7fa98 service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8c640f06-5eac-4ff2-8768-c781f58dad62 req-5b95c665-f15a-4461-a49e-22377ee7fa98 service nova] Lock "4f0cc131-8133-40a7-b331-6c87051b7646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-8c640f06-5eac-4ff2-8768-c781f58dad62 req-5b95c665-f15a-4461-a49e-22377ee7fa98 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] No waiting events found dispatching network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:11 user nova-compute[75233]: WARNING nova.compute.manager [req-8c640f06-5eac-4ff2-8768-c781f58dad62 req-5b95c665-f15a-4461-a49e-22377ee7fa98 service nova] [instance: 4f0cc131-8133-40a7-b331-6c87051b7646] Received unexpected event network-vif-plugged-6009ab44-d20d-46bc-9847-842362dc8fe2 for instance with vm_state deleted and task_state None.
Dec 05 13:53:11 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Deleted allocations for instance 4f0cc131-8133-40a7-b331-6c87051b7646
Dec 05 13:53:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7792dcd4-2620-4c12-bdde-53a8436d041b tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "4f0cc131-8133-40a7-b331-6c87051b7646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:53:12 user nova-compute[75233]: INFO nova.compute.claims [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Claim successful on node user
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:53:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.policy [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c61839790d6421c8ce129287e6dbc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6981d4b1664b71b00ba32fd7ff1425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:53:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Creating image(s)
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "/opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "/opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "/opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk 1073741824" returned: 0 in 0.057s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Successfully created port: 78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Cannot resize image /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Ensure instance console log exists: /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Successfully updated port: 78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquired lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-changed-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Refreshing instance network info cache due to event network-changed-78d559cd-9c46-470c-91cb-b3390ee96944. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] Acquiring lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updating instance_info_cache with network_info: [{"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Releasing lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Instance network_info: |[{"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] Acquired lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Refreshing network info cache for port 78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Start _get_guest_xml network_info=[{"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:53:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:53:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505085857',display_name='tempest-ServersNegativeTestJSON-server-505085857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505085857',id=30,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6981d4b1664b71b00ba32fd7ff1425',ramdisk_id='',reservation_id='r-8dicuhux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1092330110',owner_user_name='tempest-ServersNegativeTestJSON-1092330110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:53:13Z,user_data=None,user_id='6c61839790d6421c8ce129287e6dbc0b',uuid=05d8a032-7b26-4106-afe5-4bc5b811388a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converting VIF {"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lazy-loading 'pci_devices' on Instance uuid 05d8a032-7b26-4106-afe5-4bc5b811388a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:53:14 user nova-compute[75233]:   <uuid>05d8a032-7b26-4106-afe5-4bc5b811388a</uuid>
Dec 05 13:53:14 user nova-compute[75233]:   <name>instance-0000001e</name>
Dec 05 13:53:14 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:53:14 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:53:14 user nova-compute[75233]:   <metadata>
Dec 05 13:53:14 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:53:14 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:53:14 user nova-compute[75233]:       <nova:name>tempest-ServersNegativeTestJSON-server-505085857</nova:name>
Dec 05 13:53:14 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:53:14</nova:creationTime>
Dec 05 13:53:14 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:53:14 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:53:14 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:53:14 user nova-compute[75233]:       <nova:owner>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:user uuid="6c61839790d6421c8ce129287e6dbc0b">tempest-ServersNegativeTestJSON-1092330110-project-member</nova:user>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:project uuid="8d6981d4b1664b71b00ba32fd7ff1425">tempest-ServersNegativeTestJSON-1092330110</nova:project>
Dec 05 13:53:14 user nova-compute[75233]:       </nova:owner>
Dec 05 13:53:14 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:53:14 user nova-compute[75233]:       <nova:ports>
Dec 05 13:53:14 user nova-compute[75233]:         <nova:port uuid="78d559cd-9c46-470c-91cb-b3390ee96944">
Dec 05 13:53:14 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 13:53:14 user nova-compute[75233]:         </nova:port>
Dec 05 13:53:14 user nova-compute[75233]:       </nova:ports>
Dec 05 13:53:14 user nova-compute[75233]:     </nova:instance>
Dec 05 13:53:14 user nova-compute[75233]:   </metadata>
Dec 05 13:53:14 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:53:14 user nova-compute[75233]:     <system>
Dec 05 13:53:14 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:53:14 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:53:14 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:53:14 user nova-compute[75233]:       <entry name="serial">05d8a032-7b26-4106-afe5-4bc5b811388a</entry>
Dec 05 13:53:14 user nova-compute[75233]:       <entry name="uuid">05d8a032-7b26-4106-afe5-4bc5b811388a</entry>
Dec 05 13:53:14 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:53:14 user nova-compute[75233]:     </system>
Dec 05 13:53:14 user nova-compute[75233]:   </sysinfo>
Dec 05 13:53:14 user nova-compute[75233]:   <os>
Dec 05 13:53:14 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:53:14 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:53:14 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:53:14 user nova-compute[75233]:   </os>
Dec 05 13:53:14 user nova-compute[75233]:   <features>
Dec 05 13:53:14 user nova-compute[75233]:     <acpi/>
Dec 05 13:53:14 user nova-compute[75233]:     <apic/>
Dec 05 13:53:14 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:53:14 user nova-compute[75233]:   </features>
Dec 05 13:53:14 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:53:14 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:53:14 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:53:14 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:53:14 user nova-compute[75233]:   </clock>
Dec 05 13:53:14 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:53:14 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:53:14 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:53:14 user nova-compute[75233]:   </cpu>
Dec 05 13:53:14 user nova-compute[75233]:   <devices>
Dec 05 13:53:14 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:53:14 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:53:14 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk"/>
Dec 05 13:53:14 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:53:14 user nova-compute[75233]:     </disk>
Dec 05 13:53:14 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:53:14 user nova-compute[75233]:       <mac address="fa:16:3e:b0:09:fe"/>
Dec 05 13:53:14 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:53:14 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:53:14 user nova-compute[75233]:       <target dev="tap78d559cd-9c"/>
Dec 05 13:53:14 user nova-compute[75233]:     </interface>
Dec 05 13:53:14 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:53:14 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/console.log" append="off"/>
Dec 05 13:53:14 user nova-compute[75233]:     </serial>
Dec 05 13:53:14 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:53:14 user nova-compute[75233]:     <video>
Dec 05 13:53:14 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:53:14 user nova-compute[75233]:     </video>
Dec 05 13:53:14 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:53:14 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:53:14 user nova-compute[75233]:     </rng>
Dec 05 13:53:14 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:53:14 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:53:14 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:53:14 user nova-compute[75233]:     </memballoon>
Dec 05 13:53:14 user nova-compute[75233]:   </devices>
Dec 05 13:53:14 user nova-compute[75233]: </domain>
Dec 05 13:53:14 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505085857',display_name='tempest-ServersNegativeTestJSON-server-505085857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505085857',id=30,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6981d4b1664b71b00ba32fd7ff1425',ramdisk_id='',reservation_id='r-8dicuhux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1092330110',owner_user_name='tempest-ServersNegativeTestJSON-1092330110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:53:13Z,user_data=None,user_id='6c61839790d6421c8ce129287e6dbc0b',uuid=05d8a032-7b26-4106-afe5-4bc5b811388a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converting VIF {"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG os_vif [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ced17079-76f4-5063-af50-f48ac824b1a3', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78d559cd-9c, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78d559cd-9c, col_values=(('qos', UUID('1ec3542e-7d7b-4a7c-a7a0-332558daf3d2')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78d559cd-9c, col_values=(('external_ids', {'iface-id': '78d559cd-9c46-470c-91cb-b3390ee96944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:09:fe', 'vm-uuid': '05d8a032-7b26-4106-afe5-4bc5b811388a'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:14 user nova-compute[75233]: INFO os_vif [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c')
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] No VIF found with MAC fa:16:3e:b0:09:fe, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updated VIF entry in instance network info cache for port 78d559cd-9c46-470c-91cb-b3390ee96944. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updating instance_info_cache with network_info: [{"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ff001fa6-a152-4b5e-ad70-5aad5304ea88 req-f4e6d35d-d25d-420d-a08d-defbf07ec4c1 service nova] Releasing lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-42445288-e08b-483b-92f0-ec976062a508 req-0a7e1712-c309-4078-9520-ded304327f0a service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-42445288-e08b-483b-92f0-ec976062a508 req-0a7e1712-c309-4078-9520-ded304327f0a service nova] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-42445288-e08b-483b-92f0-ec976062a508 req-0a7e1712-c309-4078-9520-ded304327f0a service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-42445288-e08b-483b-92f0-ec976062a508 req-0a7e1712-c309-4078-9520-ded304327f0a service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-42445288-e08b-483b-92f0-ec976062a508 req-0a7e1712-c309-4078-9520-ded304327f0a service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] No waiting events found dispatching network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:16 user nova-compute[75233]: WARNING nova.compute.manager [req-42445288-e08b-483b-92f0-ec976062a508 req-0a7e1712-c309-4078-9520-ded304327f0a service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received unexpected event network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 for instance with vm_state building and task_state spawning.
Dec 05 13:53:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:53:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Instance spawned successfully.
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:53:18 user nova-compute[75233]: INFO nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Took 5.19 seconds to spawn the instance on the hypervisor.
Dec 05 13:53:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:53:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c205bdc-6ecd-4a79-bebe-39578863b256 req-28a0d2f6-1192-4ccd-bd7f-9aa488810448 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c205bdc-6ecd-4a79-bebe-39578863b256 req-28a0d2f6-1192-4ccd-bd7f-9aa488810448 service nova] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c205bdc-6ecd-4a79-bebe-39578863b256 req-28a0d2f6-1192-4ccd-bd7f-9aa488810448 service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c205bdc-6ecd-4a79-bebe-39578863b256 req-28a0d2f6-1192-4ccd-bd7f-9aa488810448 service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c205bdc-6ecd-4a79-bebe-39578863b256 req-28a0d2f6-1192-4ccd-bd7f-9aa488810448 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] No waiting events found dispatching network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:18 user nova-compute[75233]: WARNING nova.compute.manager [req-4c205bdc-6ecd-4a79-bebe-39578863b256 req-28a0d2f6-1192-4ccd-bd7f-9aa488810448 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received unexpected event network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 for instance with vm_state active and task_state None.
Dec 05 13:53:18 user nova-compute[75233]: INFO nova.compute.manager [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Took 5.94 seconds to build instance.
Dec 05 13:53:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e1dd99fd-403d-4f49-8cc4-ac0da62362c2 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.040s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:20 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b4b42e4d-f5e2-48ec-842a-536a1f250585 is timed out.
Dec 05 13:53:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully detached device vdb from instance b4b42e4d-f5e2-48ec-842a-536a1f250585 from the live domain config.
Dec 05 13:53:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwZtCiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:53:20 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50643fd8-db88-4ef7-a7b1-d356e6501627]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:53:20 user nova-compute[75233]: No targets found.
Dec 05 13:53:20 user nova-compute[75233]: iSNS:
Dec 05 13:53:20 user nova-compute[75233]: No targets found.
Dec 05 13:53:20 user nova-compute[75233]: STATIC:
Dec 05 13:53:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:53:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:53:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966
Dec 05 13:53:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:53:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:20 user nova-compute[75233]: FIRMWARE:
Dec 05 13:53:20 user nova-compute[75233]: No targets found.
Dec 05 13:53:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:53:20 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:53:20 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b033e08-243d-4aaa-84ec-f9dce8af78f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[146990ba-573e-4102-ac6e-4d6682cd4a32]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:53:20 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:53:20 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:53:20 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:53:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 (non-flash)
Dec 05 13:53:20 user nova-compute[75233]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:53:20 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:53:20 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:53:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f58702d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:53:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[61278d90-3ef7-4698-a58f-523a9c72a8af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e4afb-2cc0-444e-8620-c0d80a83bcc6]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c232eb-7ffe-4731-8dcb-dce137f3f146]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[de85308c-f020-4451-a154-ccc2e91e988a]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c310fce-f52a-4a55-87a6-adec016358f6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fba66d11-7258-45dd-9d43-d6243d334d16 is timed out.
Dec 05 13:53:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully detached device vdb from instance fba66d11-7258-45dd-9d43-d6243d334d16 from the live domain config.
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztlnbXTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:53:21 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e306a7-249a-4287-9b52-3d3f8fa64415]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260]
Dec 05 13:53:21 user nova-compute[75233]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966, portal: 172.16.0.220,3260] successful.
Dec 05 13:53:21 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519c9a-cc14-47bf-a26a-acc1dae0d966 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c3d4f-606c-4729-bf9a-aaa7cccfae4b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] <== disconnect_volume: return (340ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.042s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dbd113-7d3b-4f27-87a1-0f4b9965aa6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:53:21 user nova-compute[75233]: No targets found.
Dec 05 13:53:21 user nova-compute[75233]: iSNS:
Dec 05 13:53:21 user nova-compute[75233]: No targets found.
Dec 05 13:53:21 user nova-compute[75233]: STATIC:
Dec 05 13:53:21 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3
Dec 05 13:53:21 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:21 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:21 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:53:21 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:21 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:21 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:53:21 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:21 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:21 user nova-compute[75233]: FIRMWARE:
Dec 05 13:53:21 user nova-compute[75233]: No targets found.
Dec 05 13:53:21 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:53:21 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:53:21 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca114cf-cc2e-4253-aaa9-a318c6fe5075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8820700d-45a3-4fdb-8b14-ea266ec94798]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:53:21 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:53:21 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:53:21 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 (non-flash)
Dec 05 13:53:21 user nova-compute[75233]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:53:21 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:53:21 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f58702e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b2f49e-0723-4030-9e11-17de7e9bf4b4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02822e11-cff9-4f7c-940b-49bec26d63f0]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21285525-66f8-4036-8a90-4d0bf4bc9f95]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e4c4d-fc5b-4868-91d9-8d2339635730]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b65c52-85c2-4dce-8fec-ed45579b7a15]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adc2b20-bfa1-48ae-927a-a1bbc52b3e97]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260]
Dec 05 13:53:21 user nova-compute[75233]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3, portal: 172.16.0.220,3260] successful.
Dec 05 13:53:21 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b36fdd-e4f1-4f08-9bd5-afbf1b547ee3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3751a9da-4b89-4725-94f5-f19e7bec2715]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== disconnect_volume: return (360ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:53:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:53:22 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'flavor' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6a264f5a-2daf-4410-be30-4c28dcf3172f tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:22 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'flavor' on Instance uuid fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b166e583-47b7-4757-8cd8-e408df544f17 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.198s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing instance network info cache due to event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:53:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updated VIF entry in instance network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bbdf1d3c-1cda-40bc-8dff-85c49eb6a79a req-8b91c302-2c90-4ac3-a341-c9a6bf97ecae service nova] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:49 user nova-compute[75233]: INFO nova.compute.manager [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Shelve offloading
Dec 05 13:53:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-9013441a-eb1e-413f-9ba5-76ead69a5371 req-33f5e3ed-4317-47f0-b7a7-e380ee2dd357 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-unplugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9013441a-eb1e-413f-9ba5-76ead69a5371 req-33f5e3ed-4317-47f0-b7a7-e380ee2dd357 service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9013441a-eb1e-413f-9ba5-76ead69a5371 req-33f5e3ed-4317-47f0-b7a7-e380ee2dd357 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9013441a-eb1e-413f-9ba5-76ead69a5371 req-33f5e3ed-4317-47f0-b7a7-e380ee2dd357 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-9013441a-eb1e-413f-9ba5-76ead69a5371 req-33f5e3ed-4317-47f0-b7a7-e380ee2dd357 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-unplugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:49 user nova-compute[75233]: WARNING nova.compute.manager [req-9013441a-eb1e-413f-9ba5-76ead69a5371 req-33f5e3ed-4317-47f0-b7a7-e380ee2dd357 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-unplugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state active and task_state shelving.
Dec 05 13:53:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance destroyed successfully.
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:50 user nova-compute[75233]: INFO nova.compute.manager [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Terminating instance
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:50 user nova-compute[75233]: INFO nova.compute.manager [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Terminating instance
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-4db9bfa4-726d-44c8-a12e-c9c84bf32715 req-0241d12d-0658-4fda-b039-c721f6546eb4 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4db9bfa4-726d-44c8-a12e-c9c84bf32715 req-0241d12d-0658-4fda-b039-c721f6546eb4 service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4db9bfa4-726d-44c8-a12e-c9c84bf32715 req-0241d12d-0658-4fda-b039-c721f6546eb4 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4db9bfa4-726d-44c8-a12e-c9c84bf32715 req-0241d12d-0658-4fda-b039-c721f6546eb4 service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-4db9bfa4-726d-44c8-a12e-c9c84bf32715 req-0241d12d-0658-4fda-b039-c721f6546eb4 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-4db9bfa4-726d-44c8-a12e-c9c84bf32715 req-0241d12d-0658-4fda-b039-c721f6546eb4 service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-unplugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Instance destroyed successfully.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'resources' on Instance uuid b4b42e4d-f5e2-48ec-842a-536a1f250585 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-680434618',display_name='tempest-ServerRescueNegativeTestJSON-server-680434618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-680434618',id=21,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpccRe6hIADiJ7Et68v/LZB0pXu1DVkRqKIgjrV5HlRSbTkySUEcjRhIMF4tGXTsUKj9ERGLozGck76J7eTzgkALmXLWlmj4hy7CLqM5BYmPrSkCZzMJpLz8466cLaacg==',key_name='tempest-keypair-1531648438',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1gvknz6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:51:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=b4b42e4d-f5e2-48ec-842a-536a1f250585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "address": "fa:16:3e:9f:2a:f2", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1405dadf-e1", "ovs_interfaceid": "1405dadf-e129-4a04-b5e2-ef49395ebcdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_vif [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1405dadf-e1, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Instance destroyed successfully.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.objects.instance [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'resources' on Instance uuid fba66d11-7258-45dd-9d43-d6243d334d16 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1578695365',display_name='tempest-ServerActionsTestOtherA-server-1393086925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1578695365',id=23,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2aipfGk9HZY+V9iR6F0Sb1fi8n5MWQBWblZVcpCDCSsj+DE07vFNMf3l17q6NduKyPOjiOyJyh0mIGrWeTQ3Ko/XAtOQSdBAislQFq4jImzaXh1gAjPT/8p5R03T9rA==',key_name='tempest-keypair-798902531',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-dr7was46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=fba66d11-7258-45dd-9d43-d6243d334d16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "7620b802-6381-4721-a397-881e11466092", "address": "fa:16:3e:a5:38:cd", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7620b802-63", "ovs_interfaceid": "7620b802-6381-4721-a397-881e11466092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_vif [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:51 user nova-compute[75233]: WARNING nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state active and task_state shelving.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-unplugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-unplugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-unplugged-7620b802-6381-4721-a397-881e11466092 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Acquiring lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] Lock "fba66d11-7258-45dd-9d43-d6243d334d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] No waiting events found dispatching network-vif-plugged-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:51 user nova-compute[75233]: WARNING nova.compute.manager [req-23001268-a9bc-45ef-b9b6-b0ffab9d2940 req-e491e7e7-0e49-4fdf-8837-0ab57601042c service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received unexpected event network-vif-plugged-7620b802-6381-4721-a397-881e11466092 for instance with vm_state active and task_state deleting.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7620b802-63, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fceefd9-8c62-465f-80fc-aaa3b032a020) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance destroyed successfully.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'resources' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86f5175f-886a-4416-a788-2c99a16da467) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960902112',display_name='tempest-TestShelveInstance-server-1960902112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960902112',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqD6WhrnXmiRW6UXmwMGeYCxWEp54KSCoF1cUNUNvzuH88P8LyQoj5K8VQfPp0m0PFLPj8SpCtTo4oSUAkNjOiWhIJy65Ab7WVh2gX6etDGo/XvaGYSBT0ZUKHs8jGwg==',key_name='tempest-TestShelveInstance-2054970852',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:52:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ab64efbb5940c4a62331f4fce76a62',ramdisk_id='',reservation_id='r-j50rbkmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1187931716',owner_user_name='tempest-TestShelveInstance-1187931716-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:52:12Z,user_data=None,user_id='a35a118fda664fe5a60df4a41ea7dc05',uuid=a83ef82d-ed7f-41e7-8666-f74b251c1ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converting VIF {"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_vif [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: INFO os_vif [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:2a:f2,bridge_name='br-int',has_traffic_filtering=True,id=1405dadf-e129-4a04-b5e2-ef49395ebcdd,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1405dadf-e1')
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Deleting instance files /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585_del
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Deletion of /opt/stack/data/nova/instances/b4b42e4d-f5e2-48ec-842a-536a1f250585_del complete
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing instance network info cache due to event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.neutron [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49f84095-c6, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:51 user nova-compute[75233]: INFO os_vif [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:38:cd,bridge_name='br-int',has_traffic_filtering=True,id=7620b802-6381-4721-a397-881e11466092,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7620b802-63')
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Deleting instance files /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16_del
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Deletion of /opt/stack/data/nova/instances/fba66d11-7258-45dd-9d43-d6243d334d16_del complete
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50a8bbec-c53e-4f25-b59e-579652afab08) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:51 user nova-compute[75233]: INFO os_vif [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6')
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:53:51 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.compute.manager [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Took 1.26 seconds to destroy the instance on the hypervisor.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a854a0d9-9a2a-419f-8c28-3441e36b49a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:53:51 user nova-compute[75233]: No targets found.
Dec 05 13:53:51 user nova-compute[75233]: iSNS:
Dec 05 13:53:51 user nova-compute[75233]: No targets found.
Dec 05 13:53:51 user nova-compute[75233]: STATIC:
Dec 05 13:53:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:53:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:51 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:53:51 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:53:51 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:53:51 user nova-compute[75233]: FIRMWARE:
Dec 05 13:53:51 user nova-compute[75233]: No targets found.
Dec 05 13:53:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:53:51 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:53:51 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: INFO nova.compute.manager [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Took 1.07 seconds to destroy the instance on the hypervisor.
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a17cc-feee-4172-9219-7479ff66097b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ede0a1-9e01-4210-9e55-2bdefbbb88ae]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:53:51 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:53:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:53:51 user nova-compute[75233]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:53:51 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34619a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[59229839-85e8-49d6-a3ec-7229996af754]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b679381-6c1c-449a-88dc-a3f8d16c7aef]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9257da-c6ce-4e2c-abfc-c228346bb730]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e8e790-5d04-4898-9ea9-7f588865c0fe]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3538d-aba9-4302-8c31-056e55999796]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:51 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9129dd-f368-4dbb-807a-b1d1a8eab66a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]
Dec 05 13:53:52 user nova-compute[75233]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.
Dec 05 13:53:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fead831-2bb9-4f24-adbf-de5602b62819]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] <== disconnect_volume: return (305ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:53:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Deleting instance files /opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2_del
Dec 05 13:53:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Deletion of /opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2_del complete
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.network.neutron [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updated VIF entry in instance network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.network.neutron [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": null, "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap49f84095-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8fc59c67-1cbe-403d-8611-4978f8f06b46 req-358d495b-6d29-4d7e-868f-4c286bdf25b9 service nova] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:52 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Took 0.74 seconds to deallocate network for instance.
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:53:52 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Took 0.95 seconds to deallocate network for instance.
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] Acquiring lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] No waiting events found dispatching network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:53:52 user nova-compute[75233]: WARNING nova.compute.manager [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received unexpected event network-vif-plugged-1405dadf-e129-4a04-b5e2-ef49395ebcdd for instance with vm_state deleted and task_state None.
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-b23fbe3a-dfc7-4af2-aefd-dcf1ddfc35cf req-b9e86f6e-d2dc-4af8-96e7-b2e2c818e28e service nova] [instance: fba66d11-7258-45dd-9d43-d6243d334d16] Received event network-vif-deleted-7620b802-6381-4721-a397-881e11466092 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.356s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:53:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.156s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:53 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Deleted allocations for instance b4b42e4d-f5e2-48ec-842a-536a1f250585
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a72aad72-1daa-4397-9795-b0efd831c2a8 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "b4b42e4d-f5e2-48ec-842a-536a1f250585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.601s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:53 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Deleted allocations for instance a83ef82d-ed7f-41e7-8666-f74b251c1ce2
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.218s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'numa_topology' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.objects.base [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Object Instance<a83ef82d-ed7f-41e7-8666-f74b251c1ce2> lazy-loaded attributes: resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:53:53 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Deleted allocations for instance fba66d11-7258-45dd-9d43-d6243d334d16
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afd9444d-31fc-4936-9264-64c5afe966f5 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "fba66d11-7258-45dd-9d43-d6243d334d16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-0baf1e56-2f1a-450f-af1e-d0b0f4893330 req-e119ae29-211d-42a8-ae43-07fb4e4c8e7e service nova] [instance: b4b42e4d-f5e2-48ec-842a-536a1f250585] Received event network-vif-deleted-1405dadf-e129-4a04-b5e2-ef49395ebcdd {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d58d2b9b-ce12-48d8-89ab-313a3b756857 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.595s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:53:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:53:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=25.09927749633789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5164ddc7-a09d-46b5-893c-c42aad687a3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 47d20f82-0294-43b9-97a3-7ae8c564d08d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:53:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:53:57 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:53:57 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:54:02 user nova-compute[75233]: INFO nova.compute.claims [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Claim successful on node user
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:54:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:54:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.policy [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebeefb2fa465406b911b62137057223a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a22149826499ba7d03f47ce7375cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:54:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Creating image(s)
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "/opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.168s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk 1073741824" returned: 0 in 0.057s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Successfully created port: 5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Cannot resize image /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Ensure instance console log exists: /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [{"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-47d20f82-0294-43b9-97a3-7ae8c564d08d" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Successfully updated port: 5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquired lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-changed-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Refreshing instance network info cache due to event network-changed-5e78e3e1-5892-426d-a2df-b51cb27fa899. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] Acquiring lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updating instance_info_cache with network_info: [{"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Releasing lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Instance network_info: |[{"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] Acquired lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.neutron [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Refreshing network info cache for port 5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Start _get_guest_xml network_info=[{"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:54:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:54:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1320016890',display_name='tempest-AttachVolumeNegativeTest-server-1320016890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1320016890',id=31,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsZcycrOwDI8D9w7dTwolh2YeTqtA1WqembduFlKH5dbb8OIhD2yS2TnjFYONzHhq1+M0+Stp92VjAV73bjLAyjnguwYLqpdtwYq44nBumt8Tlu6hxIpmUWPziADcGo5g==',key_name='tempest-keypair-1059253530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-wqikkllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=eabd1057-003a-4b46-9fa1-1378b4f7388b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'pci_devices' on Instance uuid eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:54:04 user nova-compute[75233]:   <uuid>eabd1057-003a-4b46-9fa1-1378b4f7388b</uuid>
Dec 05 13:54:04 user nova-compute[75233]:   <name>instance-0000001f</name>
Dec 05 13:54:04 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:54:04 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:54:04 user nova-compute[75233]:   <metadata>
Dec 05 13:54:04 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:54:04 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:54:04 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1320016890</nova:name>
Dec 05 13:54:04 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:54:04</nova:creationTime>
Dec 05 13:54:04 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:54:04 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:54:04 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:54:04 user nova-compute[75233]:       <nova:owner>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:user uuid="ebeefb2fa465406b911b62137057223a">tempest-AttachVolumeNegativeTest-525245035-project-member</nova:user>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:project uuid="f73a22149826499ba7d03f47ce7375cd">tempest-AttachVolumeNegativeTest-525245035</nova:project>
Dec 05 13:54:04 user nova-compute[75233]:       </nova:owner>
Dec 05 13:54:04 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:54:04 user nova-compute[75233]:       <nova:ports>
Dec 05 13:54:04 user nova-compute[75233]:         <nova:port uuid="5e78e3e1-5892-426d-a2df-b51cb27fa899">
Dec 05 13:54:04 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:54:04 user nova-compute[75233]:         </nova:port>
Dec 05 13:54:04 user nova-compute[75233]:       </nova:ports>
Dec 05 13:54:04 user nova-compute[75233]:     </nova:instance>
Dec 05 13:54:04 user nova-compute[75233]:   </metadata>
Dec 05 13:54:04 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:54:04 user nova-compute[75233]:     <system>
Dec 05 13:54:04 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:54:04 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:54:04 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:54:04 user nova-compute[75233]:       <entry name="serial">eabd1057-003a-4b46-9fa1-1378b4f7388b</entry>
Dec 05 13:54:04 user nova-compute[75233]:       <entry name="uuid">eabd1057-003a-4b46-9fa1-1378b4f7388b</entry>
Dec 05 13:54:04 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:54:04 user nova-compute[75233]:     </system>
Dec 05 13:54:04 user nova-compute[75233]:   </sysinfo>
Dec 05 13:54:04 user nova-compute[75233]:   <os>
Dec 05 13:54:04 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:54:04 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:54:04 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:54:04 user nova-compute[75233]:   </os>
Dec 05 13:54:04 user nova-compute[75233]:   <features>
Dec 05 13:54:04 user nova-compute[75233]:     <acpi/>
Dec 05 13:54:04 user nova-compute[75233]:     <apic/>
Dec 05 13:54:04 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:54:04 user nova-compute[75233]:   </features>
Dec 05 13:54:04 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:54:04 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:54:04 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:54:04 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:54:04 user nova-compute[75233]:   </clock>
Dec 05 13:54:04 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:54:04 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:54:04 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:54:04 user nova-compute[75233]:   </cpu>
Dec 05 13:54:04 user nova-compute[75233]:   <devices>
Dec 05 13:54:04 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:54:04 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:54:04 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk"/>
Dec 05 13:54:04 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:54:04 user nova-compute[75233]:     </disk>
Dec 05 13:54:04 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:54:04 user nova-compute[75233]:       <mac address="fa:16:3e:e0:96:8a"/>
Dec 05 13:54:04 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:54:04 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:54:04 user nova-compute[75233]:       <target dev="tap5e78e3e1-58"/>
Dec 05 13:54:04 user nova-compute[75233]:     </interface>
Dec 05 13:54:04 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:54:04 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/console.log" append="off"/>
Dec 05 13:54:04 user nova-compute[75233]:     </serial>
Dec 05 13:54:04 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:54:04 user nova-compute[75233]:     <video>
Dec 05 13:54:04 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:54:04 user nova-compute[75233]:     </video>
Dec 05 13:54:04 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:54:04 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:54:04 user nova-compute[75233]:     </rng>
Dec 05 13:54:04 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:54:04 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:54:04 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:54:04 user nova-compute[75233]:     </memballoon>
Dec 05 13:54:04 user nova-compute[75233]:   </devices>
Dec 05 13:54:04 user nova-compute[75233]: </domain>
Dec 05 13:54:04 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1320016890',display_name='tempest-AttachVolumeNegativeTest-server-1320016890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1320016890',id=31,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsZcycrOwDI8D9w7dTwolh2YeTqtA1WqembduFlKH5dbb8OIhD2yS2TnjFYONzHhq1+M0+Stp92VjAV73bjLAyjnguwYLqpdtwYq44nBumt8Tlu6hxIpmUWPziADcGo5g==',key_name='tempest-keypair-1059253530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-wqikkllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=eabd1057-003a-4b46-9fa1-1378b4f7388b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG os_vif [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faf1d4ea-447d-5951-9c98-ff8cc47c300f', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e78e3e1-58, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e78e3e1-58, col_values=(('qos', UUID('4e2681b0-b303-432b-b08a-6351c4ec91bf')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e78e3e1-58, col_values=(('external_ids', {'iface-id': '5e78e3e1-5892-426d-a2df-b51cb27fa899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:96:8a', 'vm-uuid': 'eabd1057-003a-4b46-9fa1-1378b4f7388b'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:04 user nova-compute[75233]: INFO os_vif [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58')
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:54:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:e0:96:8a, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:54:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updated VIF entry in instance network info cache for port 5e78e3e1-5892-426d-a2df-b51cb27fa899. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:54:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updating instance_info_cache with network_info: [{"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f88f05bf-761b-4030-8f59-1a411a47a15d req-54cad904-4616-4ee9-8a50-a626d98df9c5 service nova] Releasing lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:54:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-60efd816-b464-4897-a223-0c4e3372ed0d req-b0ea5503-7ecf-4f47-aa36-414be91a67ba service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-60efd816-b464-4897-a223-0c4e3372ed0d req-b0ea5503-7ecf-4f47-aa36-414be91a67ba service nova] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-60efd816-b464-4897-a223-0c4e3372ed0d req-b0ea5503-7ecf-4f47-aa36-414be91a67ba service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-60efd816-b464-4897-a223-0c4e3372ed0d req-b0ea5503-7ecf-4f47-aa36-414be91a67ba service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-60efd816-b464-4897-a223-0c4e3372ed0d req-b0ea5503-7ecf-4f47-aa36-414be91a67ba service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] No waiting events found dispatching network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:06 user nova-compute[75233]: WARNING nova.compute.manager [req-60efd816-b464-4897-a223-0c4e3372ed0d req-b0ea5503-7ecf-4f47-aa36-414be91a67ba service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received unexpected event network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 for instance with vm_state building and task_state spawning.
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:54:08 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Instance spawned successfully.
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:54:08 user nova-compute[75233]: INFO nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Took 5.32 seconds to spawn the instance on the hypervisor.
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-d3de2b8b-5ced-4af9-a5ac-0227dc82d9cc req-332d3ef1-1d24-4d3a-a14f-1364f858d537 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d3de2b8b-5ced-4af9-a5ac-0227dc82d9cc req-332d3ef1-1d24-4d3a-a14f-1364f858d537 service nova] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d3de2b8b-5ced-4af9-a5ac-0227dc82d9cc req-332d3ef1-1d24-4d3a-a14f-1364f858d537 service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d3de2b8b-5ced-4af9-a5ac-0227dc82d9cc req-332d3ef1-1d24-4d3a-a14f-1364f858d537 service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-d3de2b8b-5ced-4af9-a5ac-0227dc82d9cc req-332d3ef1-1d24-4d3a-a14f-1364f858d537 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] No waiting events found dispatching network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:08 user nova-compute[75233]: WARNING nova.compute.manager [req-d3de2b8b-5ced-4af9-a5ac-0227dc82d9cc req-332d3ef1-1d24-4d3a-a14f-1364f858d537 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received unexpected event network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 for instance with vm_state building and task_state spawning.
Dec 05 13:54:08 user nova-compute[75233]: INFO nova.compute.manager [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Took 6.03 seconds to build instance.
Dec 05 13:54:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6018f2e-55c3-47c3-90cb-f6c77b754c99 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.123s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:54:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:54:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:54:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:54:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:26 user nova-compute[75233]: INFO nova.compute.manager [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Terminating instance
Dec 05 13:54:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-15c4e763-8443-41fc-9c7f-4eae55aceaa7 req-ee0174c0-ab08-4345-ba6b-c3509786b6bc service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-15c4e763-8443-41fc-9c7f-4eae55aceaa7 req-ee0174c0-ab08-4345-ba6b-c3509786b6bc service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-15c4e763-8443-41fc-9c7f-4eae55aceaa7 req-ee0174c0-ab08-4345-ba6b-c3509786b6bc service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-15c4e763-8443-41fc-9c7f-4eae55aceaa7 req-ee0174c0-ab08-4345-ba6b-c3509786b6bc service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-15c4e763-8443-41fc-9c7f-4eae55aceaa7 req-ee0174c0-ab08-4345-ba6b-c3509786b6bc service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-15c4e763-8443-41fc-9c7f-4eae55aceaa7 req-ee0174c0-ab08-4345-ba6b-c3509786b6bc service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-unplugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:54:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Instance destroyed successfully.
Dec 05 13:54:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'resources' on Instance uuid 47d20f82-0294-43b9-97a3-7ae8c564d08d {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-460475358',display_name='tempest-AttachVolumeTestJSON-server-460475358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-460475358',id=18,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz3UfyFlbaAhwLLPSr7ySwCkuNbnTKEiRo1XoR+QAtqlrechlNPJQiRW5YkgT6xBjPhRTCPuTHD28f4YbeA39btYwztHw43LVDPeckjH9cra2xKJ9/fB6JfVw9a9O6sxA==',key_name='tempest-keypair-1706671907',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-80kxbtve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=47d20f82-0294-43b9-97a3-7ae8c564d08d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "address": "fa:16:3e:d5:3a:57", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99da560f-01", "ovs_interfaceid": "99da560f-01fc-4f4c-81f8-7d3a72dc8d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG os_vif [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99da560f-01, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f0690a5-b55b-46a6-af62-e871c23f3ae6) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:27 user nova-compute[75233]: INFO os_vif [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:3a:57,bridge_name='br-int',has_traffic_filtering=True,id=99da560f-01fc-4f4c-81f8-7d3a72dc8d45,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99da560f-01')
Dec 05 13:54:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Deleting instance files /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d_del
Dec 05 13:54:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Deletion of /opt/stack/data/nova/instances/47d20f82-0294-43b9-97a3-7ae8c564d08d_del complete
Dec 05 13:54:27 user nova-compute[75233]: INFO nova.compute.manager [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 05 13:54:27 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:54:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:28 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Took 1.19 seconds to deallocate network for instance.
Dec 05 13:54:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] Acquiring lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] No waiting events found dispatching network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:28 user nova-compute[75233]: WARNING nova.compute.manager [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received unexpected event network-vif-plugged-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 for instance with vm_state deleted and task_state None.
Dec 05 13:54:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-e213d314-77e1-45ab-b759-ce10f992b60e req-993bfc28-e55a-47cc-b6f0-c0f63074ccf3 service nova] [instance: 47d20f82-0294-43b9-97a3-7ae8c564d08d] Received event network-vif-deleted-99da560f-01fc-4f4c-81f8-7d3a72dc8d45 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:54:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:29 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Deleted allocations for instance 47d20f82-0294-43b9-97a3-7ae8c564d08d
Dec 05 13:54:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b8e25d62-b679-4bc5-ab99-9b1d1041c783 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "47d20f82-0294-43b9-97a3-7ae8c564d08d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:29 user nova-compute[75233]: INFO nova.compute.manager [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Rescuing
Dec 05 13:54:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:54:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:54:29 user nova-compute[75233]: DEBUG nova.network.neutron [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG nova.network.neutron [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-178a2497-0ea6-4060-864f-4cd48418e1b9 req-e88da861-32c2-4ad5-89ef-f6ed436c3f3f service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-178a2497-0ea6-4060-864f-4cd48418e1b9 req-e88da861-32c2-4ad5-89ef-f6ed436c3f3f service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-178a2497-0ea6-4060-864f-4cd48418e1b9 req-e88da861-32c2-4ad5-89ef-f6ed436c3f3f service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-178a2497-0ea6-4060-864f-4cd48418e1b9 req-e88da861-32c2-4ad5-89ef-f6ed436c3f3f service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-178a2497-0ea6-4060-864f-4cd48418e1b9 req-e88da861-32c2-4ad5-89ef-f6ed436c3f3f service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:30 user nova-compute[75233]: WARNING nova.compute.manager [req-178a2497-0ea6-4060-864f-4cd48418e1b9 req-e88da861-32c2-4ad5-89ef-f6ed436c3f3f service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state active and task_state rescuing.
Dec 05 13:54:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance destroyed successfully.
Dec 05 13:54:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Attempting a stable device rescue
Dec 05 13:54:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 13:54:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:54:31 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Creating image(s)
Dec 05 13:54:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.part --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.virt.images [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] d30d2523-c876-4b5c-9de7-72c15a605064 was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.part /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:32 user nova-compute[75233]: WARNING nova.compute.manager [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state active and task_state rescuing.
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-changed-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Refreshing instance network info cache due to event network-changed-c51e2cb3-79fc-4a6d-affb-24652036b3cc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] Acquiring lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] Acquired lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:54:32 user nova-compute[75233]: DEBUG nova.network.neutron [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Refreshing network info cache for port c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.part /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.converted" returned: 0 in 0.829s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.network.neutron [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updated VIF entry in instance network info cache for port c51e2cb3-79fc-4a6d-affb-24652036b3cc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.network.neutron [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating instance_info_cache with network_info: [{"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.338s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0e17e0e3-405c-4b34-b01f-6605f919e38c req-3deb5f37-0e89-4807-8386-201ae33a7a8b service nova] Releasing lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3,backing_fmt=raw /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3,backing_fmt=raw /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue" returned: 0 in 0.053s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'migration_context' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<ab4d6587-2b04-46f7-9756-223a264a3efa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Start _get_guest_xml network_info=[{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "vif_mac": "fa:16:3e:05:09:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd30d2523-c876-4b5c-9de7-72c15a605064', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ab4d6587-2b04-46f7-9756-223a264a3efa', 'attached_at': '', 'detached_at': '', 'volume_id': '3095420e-8025-40c7-9c5e-b89c102e03ac', 'serial': '3095420e-8025-40c7-9c5e-b89c102e03ac'}, 'delete_on_termination': False, 'attachment_id': '917835a1-9c41-4881-a11e-37d551beb4da', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'resources' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<ab4d6587-2b04-46f7-9756-223a264a3efa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'numa_topology' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<ab4d6587-2b04-46f7-9756-223a264a3efa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:54:33 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:54:33 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<ab4d6587-2b04-46f7-9756-223a264a3efa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:54:33 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:54:33 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:54:33 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a8014-aab8-4930-ad7c-09b22072beac]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GKItQhbc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 13:54:33 user nova-compute[75233]: node.name = iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:54:33 user nova-compute[75233]: node.tpgt = -1
Dec 05 13:54:33 user nova-compute[75233]: node.startup = automatic
Dec 05 13:54:33 user nova-compute[75233]: node.leading_login = No
Dec 05 13:54:33 user nova-compute[75233]: iface.iscsi_ifacename = default
Dec 05 13:54:33 user nova-compute[75233]: iface.net_ifacename = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.ipaddress = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.prefix_len = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.hwaddress = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.transport_name = tcp
Dec 05 13:54:33 user nova-compute[75233]: iface.initiatorname = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.vlan_id = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.vlan_priority = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.vlan_state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.iface_num = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.mtu = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.port = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.bootproto = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.subnet_mask = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.gateway = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_alt_client_id = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_dns = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_learn_iqn = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_vendor_id_state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_vendor_id = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.dhcp_slp_da = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.fragmentation = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.gratuitous_arp = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.incoming_forwarding = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.tos_state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.tos = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.ttl = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.delayed_ack = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.tcp_nagle = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.tcp_wsf_state = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.tcp_wsf = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.tcp_timer_scale = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.tcp_timestamp = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.redirect = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.def_task_mgmt_timeout = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.header_digest = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.data_digest = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.immediate_data = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.initial_r2t = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.data_seq_inorder = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.data_pdu_inorder = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.erl = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.max_receive_data_len = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.first_burst_len = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.max_outstanding_r2t = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.max_burst_len = 0
Dec 05 13:54:33 user nova-compute[75233]: iface.chap_auth = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.bidi_chap = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.strict_login_compliance = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.discovery_auth = <empty>
Dec 05 13:54:33 user nova-compute[75233]: iface.discovery_logout = <empty>
Dec 05 13:54:33 user nova-compute[75233]: node.discovery_address = <empty>
Dec 05 13:54:33 user nova-compute[75233]: node.discovery_port = 0
Dec 05 13:54:33 user nova-compute[75233]: node.discovery_type = static
Dec 05 13:54:33 user nova-compute[75233]: node.session.initial_cmdsn = 0
Dec 05 13:54:33 user nova-compute[75233]: node.session.initial_login_retry_max = 8
Dec 05 13:54:33 user nova-compute[75233]: node.session.xmit_thread_priority = -20
Dec 05 13:54:33 user nova-compute[75233]: node.session.cmds_max = 128
Dec 05 13:54:33 user nova-compute[75233]: node.session.queue_depth = 32
Dec 05 13:54:33 user nova-compute[75233]: node.session.nr_sessions = 1
Dec 05 13:54:33 user nova-compute[75233]: node.session.auth.authmethod = CHAP
Dec 05 13:54:33 user nova-compute[75233]: node.session.auth.username = GKItQhbc
Dec 05 13:54:33 user nova-compute[75233]: node.session.auth.password = ***
Dec 05 13:54:33 user nova-compute[75233]: node.session.auth.username_in = <empty>
Dec 05 13:54:33 user nova-compute[75233]: node.session.auth.password_in = <empty>
Dec 05 13:54:33 user nova-compute[75233]: node.session.auth.chap_algs = MD5
Dec 05 13:54:33 user nova-compute[75233]: node.session.timeo.replacement_timeout = 120
Dec 05 13:54:33 user nova-compute[75233]: node.session.err_timeo.abort_timeout = 15
Dec 05 13:54:33 user nova-compute[75233]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 13:54:33 user nova-compute[75233]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 13:54:33 user nova-compute[75233]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.FastAbort = Yes
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.InitialR2T = No
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.ImmediateData = Yes
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.MaxConnections = 1
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 13:54:33 user nova-compute[75233]: node.session.iscsi.ERL = 0
Dec 05 13:54:33 user nova-compute[75233]: node.session.scan = manual
Dec 05 13:54:33 user nova-compute[75233]: node.session.reopen_max = 0
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].address = 172.16.0.220
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].port = 3260
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].startup = manual
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].tcp.window_size = 524288
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].tcp.type_of_service = 0
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].timeo.logout_timeout = 15
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].timeo.login_timeout = 15
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].timeo.auth_timeout = 45
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].iscsi.DataDigest = None
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].iscsi.IFMarker = No
Dec 05 13:54:33 user nova-compute[75233]: node.conn[0].iscsi.OFMarker = No
Dec 05 13:54:33 user nova-compute[75233]: # END RECORD
Dec 05 13:54:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e16d2-0129-4216-9375-6c56eab5a4bf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d164e-7d99-4b92-9bf3-051bb45c1289]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKItQhbc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKItQhbc" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a83ad-1be3-4773-b33c-34920c86a10f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKItQhbc'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d1b58b-3244-43ce-a08d-7ad9c373d108]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95ea13e-5415-4958-a525-9ca24115002d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:54:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:54:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] HCTL ('36', '0', '0', 0) found on session 36 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaa9cf6-8e0e-436a-a23a-7698076eb94e]: (4, ('0 0 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching for a device in session 36 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '23765346161653436', 'path': '/dev/sde'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765346161653436', 'path': '/dev/sde'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1556427376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1556427376',id=28,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-4tgm05pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:53:01Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=ab4d6587-2b04-46f7-9756-223a264a3efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "vif_mac": "fa:16:3e:05:09:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "vif_mac": "fa:16:3e:05:09:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'pci_devices' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.objects.base [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<ab4d6587-2b04-46f7-9756-223a264a3efa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:54:34 user nova-compute[75233]:   <uuid>ab4d6587-2b04-46f7-9756-223a264a3efa</uuid>
Dec 05 13:54:34 user nova-compute[75233]:   <name>instance-0000001c</name>
Dec 05 13:54:34 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:54:34 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:54:34 user nova-compute[75233]:   <metadata>
Dec 05 13:54:34 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:54:34 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:54:34 user nova-compute[75233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1556427376</nova:name>
Dec 05 13:54:34 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:54:33</nova:creationTime>
Dec 05 13:54:34 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:54:34 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:54:34 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:54:34 user nova-compute[75233]:       <nova:owner>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:user uuid="df61cbca359144e4a0c9ce81b51ebcee">tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member</nova:user>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:project uuid="bd04a994cbca48239afebd5080f31725">tempest-ServerBootFromVolumeStableRescueTest-264323439</nova:project>
Dec 05 13:54:34 user nova-compute[75233]:       </nova:owner>
Dec 05 13:54:34 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:54:34 user nova-compute[75233]:       <nova:ports>
Dec 05 13:54:34 user nova-compute[75233]:         <nova:port uuid="8cc45a19-cc12-4332-8254-0d66824372ad">
Dec 05 13:54:34 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:54:34 user nova-compute[75233]:         </nova:port>
Dec 05 13:54:34 user nova-compute[75233]:       </nova:ports>
Dec 05 13:54:34 user nova-compute[75233]:     </nova:instance>
Dec 05 13:54:34 user nova-compute[75233]:   </metadata>
Dec 05 13:54:34 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:54:34 user nova-compute[75233]:     <system>
Dec 05 13:54:34 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:54:34 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:54:34 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:54:34 user nova-compute[75233]:       <entry name="serial">ab4d6587-2b04-46f7-9756-223a264a3efa</entry>
Dec 05 13:54:34 user nova-compute[75233]:       <entry name="uuid">ab4d6587-2b04-46f7-9756-223a264a3efa</entry>
Dec 05 13:54:34 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:54:34 user nova-compute[75233]:     </system>
Dec 05 13:54:34 user nova-compute[75233]:   </sysinfo>
Dec 05 13:54:34 user nova-compute[75233]:   <os>
Dec 05 13:54:34 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:54:34 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:54:34 user nova-compute[75233]:   </os>
Dec 05 13:54:34 user nova-compute[75233]:   <features>
Dec 05 13:54:34 user nova-compute[75233]:     <acpi/>
Dec 05 13:54:34 user nova-compute[75233]:     <apic/>
Dec 05 13:54:34 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:54:34 user nova-compute[75233]:   </features>
Dec 05 13:54:34 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:54:34 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:54:34 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:54:34 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:54:34 user nova-compute[75233]:   </clock>
Dec 05 13:54:34 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:54:34 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:54:34 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:54:34 user nova-compute[75233]:   </cpu>
Dec 05 13:54:34 user nova-compute[75233]:   <devices>
Dec 05 13:54:34 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:54:34 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:54:34 user nova-compute[75233]:       <source dev="/dev/sde"/>
Dec 05 13:54:34 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:54:34 user nova-compute[75233]:       <serial>3095420e-8025-40c7-9c5e-b89c102e03ac</serial>
Dec 05 13:54:34 user nova-compute[75233]:     </disk>
Dec 05 13:54:34 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:54:34 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:54:34 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue"/>
Dec 05 13:54:34 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 13:54:34 user nova-compute[75233]:       <boot order="1"/>
Dec 05 13:54:34 user nova-compute[75233]:     </disk>
Dec 05 13:54:34 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:54:34 user nova-compute[75233]:       <mac address="fa:16:3e:05:09:96"/>
Dec 05 13:54:34 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:54:34 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:54:34 user nova-compute[75233]:       <target dev="tap8cc45a19-cc"/>
Dec 05 13:54:34 user nova-compute[75233]:     </interface>
Dec 05 13:54:34 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:54:34 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/console.log" append="off"/>
Dec 05 13:54:34 user nova-compute[75233]:     </serial>
Dec 05 13:54:34 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:54:34 user nova-compute[75233]:     <video>
Dec 05 13:54:34 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:54:34 user nova-compute[75233]:     </video>
Dec 05 13:54:34 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:54:34 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:54:34 user nova-compute[75233]:     </rng>
Dec 05 13:54:34 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:54:34 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:54:34 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:54:34 user nova-compute[75233]:     </memballoon>
Dec 05 13:54:34 user nova-compute[75233]:   </devices>
Dec 05 13:54:34 user nova-compute[75233]: </domain>
Dec 05 13:54:34 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:54:34 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance destroyed successfully.
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:54:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No VIF found with MAC fa:16:3e:05:09:96, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-4434521f-af54-4417-bf28-0b6424726317 req-37e4391f-afe4-4d8a-8c7d-e224a0422b4e service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4434521f-af54-4417-bf28-0b6424726317 req-37e4391f-afe4-4d8a-8c7d-e224a0422b4e service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4434521f-af54-4417-bf28-0b6424726317 req-37e4391f-afe4-4d8a-8c7d-e224a0422b4e service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4434521f-af54-4417-bf28-0b6424726317 req-37e4391f-afe4-4d8a-8c7d-e224a0422b4e service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-4434521f-af54-4417-bf28-0b6424726317 req-37e4391f-afe4-4d8a-8c7d-e224a0422b4e service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:35 user nova-compute[75233]: WARNING nova.compute.manager [req-4434521f-af54-4417-bf28-0b6424726317 req-37e4391f-afe4-4d8a-8c7d-e224a0422b4e service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state active and task_state rescuing.
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:36 user nova-compute[75233]: INFO nova.compute.manager [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attaching volume d757ec1c-8de1-44ab-b7f5-76bb27d40a9c to /dev/vdb
Dec 05 13:54:37 user nova-compute[75233]: DEBUG os_brick.utils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d2da1-12dd-4e4b-8159-2b8878e5b645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd866c-46a8-4700-8317-72fe16ab55ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef92da-b2da-4bac-94a1-01dd177134c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c6c37-cf52-4335-b87f-781256faccc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:54:37 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e77545-a65c-4e39-ac71-f70016907bcc]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG os_brick.utils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating existing volume attachment record: ede4d312-7972-4f70-b26c-5c00b26cb268 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-91494e82-5ae1-4722-885b-afc0799f741d tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-fd9c1e3f-0494-474c-9b10-d14cfd672e13 req-a79f0567-2840-4bd7-9587-23eedd60621b service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fd9c1e3f-0494-474c-9b10-d14cfd672e13 req-a79f0567-2840-4bd7-9587-23eedd60621b service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fd9c1e3f-0494-474c-9b10-d14cfd672e13 req-a79f0567-2840-4bd7-9587-23eedd60621b service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fd9c1e3f-0494-474c-9b10-d14cfd672e13 req-a79f0567-2840-4bd7-9587-23eedd60621b service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-fd9c1e3f-0494-474c-9b10-d14cfd672e13 req-a79f0567-2840-4bd7-9587-23eedd60621b service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:37 user nova-compute[75233]: WARNING nova.compute.manager [req-fd9c1e3f-0494-474c-9b10-d14cfd672e13 req-a79f0567-2840-4bd7-9587-23eedd60621b service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state rescued and task_state None.
Dec 05 13:54:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:54:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 13:54:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyeDzaXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:54:50 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:54:50 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:54:50 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f498d1ac-55eb-4017-8218-2912cd39ec53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:54:50 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0759ef7e-d0b8-469b-afe5-0c97c4ecad37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c] added
Dec 05 13:54:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d20083e-13f5-4974-82b2-9ebeb4ebdd7a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f7eae-f1c9-4ce4-97e2-6d86b65e3fb5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyeDzaXA {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyeDzaXA" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b911abd-98ee-4cf3-a7c3-de80b488704a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JyeDzaXA'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48edec8-c383-447f-9eff-a9754dabcdf8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470bf9b-f16c-42c6-b252-77e8b607ac96]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:54:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:54:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a696a5-79da-48a2-8702-3cc6d54ca451]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260]
Dec 05 13:54:50 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260] successful.
Dec 05 13:54:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1903a-515a-4167-85a0-081017095be6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82869f4-098b-4601-bec1-80424597bc4b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:54:50 user nova-compute[75233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c (non-flash)
Dec 05 13:54:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:54:50 user nova-compute[75233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c (non-flash)
Dec 05 13:54:50 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8f022-c220-4697-80aa-15565933d067]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyeDzaXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:54:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:51 user nova-compute[75233]: INFO nova.compute.manager [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Terminating instance
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-87e550ca-b3a6-4d51-a206-641ffd86179c req-f18d6da5-0452-402a-9110-08aad99959f2 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-unplugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-87e550ca-b3a6-4d51-a206-641ffd86179c req-f18d6da5-0452-402a-9110-08aad99959f2 service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-87e550ca-b3a6-4d51-a206-641ffd86179c req-f18d6da5-0452-402a-9110-08aad99959f2 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-87e550ca-b3a6-4d51-a206-641ffd86179c req-f18d6da5-0452-402a-9110-08aad99959f2 service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-87e550ca-b3a6-4d51-a206-641ffd86179c req-f18d6da5-0452-402a-9110-08aad99959f2 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-unplugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-87e550ca-b3a6-4d51-a206-641ffd86179c req-f18d6da5-0452-402a-9110-08aad99959f2 service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-unplugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23431356636383764', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431356636383764', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:54:51 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:54:51 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:54:51 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:54:51 user nova-compute[75233]:   <serial>d757ec1c-8de1-44ab-b7f5-76bb27d40a9c</serial>
Dec 05 13:54:51 user nova-compute[75233]: </disk>
Dec 05 13:54:51 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Instance destroyed successfully.
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'resources' on Instance uuid 5164ddc7-a09d-46b5-893c-c42aad687a3b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355690095',display_name='tempest-ServerRescueNegativeTestJSON-server-355690095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355690095',id=2,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:40:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-1lgdd8ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:40:37Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=5164ddc7-a09d-46b5-893c-c42aad687a3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "address": "fa:16:3e:3b:e4:87", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape97d17ec-d6", "ovs_interfaceid": "e97d17ec-d682-4bbe-9c3b-5c12697d1e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG os_vif [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape97d17ec-d6, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e7cdf5a-970e-4909-aae6-02380b586c50) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:52 user nova-compute[75233]: INFO os_vif [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e4:87,bridge_name='br-int',has_traffic_filtering=True,id=e97d17ec-d682-4bbe-9c3b-5c12697d1e9f,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape97d17ec-d6')
Dec 05 13:54:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Deleting instance files /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b_del
Dec 05 13:54:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Deletion of /opt/stack/data/nova/instances/5164ddc7-a09d-46b5-893c-c42aad687a3b_del complete
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No VIF found with MAC fa:16:3e:5b:80:e7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:54:52 user nova-compute[75233]: INFO nova.compute.manager [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ff27d7e0-7504-4b44-8ced-51f688a6b2cd tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.468s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:54:52 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Took 0.57 seconds to deallocate network for instance.
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:53 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Deleted allocations for instance 5164ddc7-a09d-46b5-893c-c42aad687a3b
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] Acquiring lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] No waiting events found dispatching network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:54:53 user nova-compute[75233]: WARNING nova.compute.manager [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received unexpected event network-vif-plugged-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f for instance with vm_state deleted and task_state None.
Dec 05 13:54:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-d0a73a00-053c-4975-a89d-76f88d12b517 req-f82d4538-fedf-45ca-9d2a-ead94ed8ffac service nova] [instance: 5164ddc7-a09d-46b5-893c-c42aad687a3b] Received event network-vif-deleted-e97d17ec-d682-4bbe-9c3b-5c12697d1e9f {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:54:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4d1c1a59-f258-428a-aa05-0cacbb6bc2e9 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "5164ddc7-a09d-46b5-893c-c42aad687a3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:54:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:54:57 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:54:57 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7850MB free_disk=25.028789520263672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance eabd1057-003a-4b46-9fa1-1378b4f7388b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:54:57 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:54:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 13:55:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:55:03 user nova-compute[75233]: INFO nova.compute.claims [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Claim successful on node user
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:55:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:55:03 user nova-compute[75233]: DEBUG nova.policy [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c61839790d6421c8ce129287e6dbc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6981d4b1664b71b00ba32fd7ff1425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:55:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Creating image(s)
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "/opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "/opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "/opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.241s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk 1073741824" returned: 0 in 0.064s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.223s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Cannot resize image /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Ensure instance console log exists: /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Successfully created port: d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:55:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Successfully updated port: d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "refresh_cache-6acef074-442c-46e9-8d68-b8826ac7c2f4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquired lock "refresh_cache-6acef074-442c-46e9-8d68-b8826ac7c2f4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-changed-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Refreshing instance network info cache due to event network-changed-d3d25588-8e21-47aa-b90a-78fb04eb9e0e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] Acquiring lock "refresh_cache-6acef074-442c-46e9-8d68-b8826ac7c2f4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Updating instance_info_cache with network_info: [{"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Releasing lock "refresh_cache-6acef074-442c-46e9-8d68-b8826ac7c2f4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Instance network_info: |[{"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] Acquired lock "refresh_cache-6acef074-442c-46e9-8d68-b8826ac7c2f4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Refreshing network info cache for port d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Start _get_guest_xml network_info=[{"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:55:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:55:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1363989773',display_name='tempest-ServersNegativeTestJSON-server-1363989773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1363989773',id=32,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6981d4b1664b71b00ba32fd7ff1425',ramdisk_id='',reservation_id='r-lzwr2a0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1092330110',owner_user_name='tempest-ServersNegativeTestJSON-1092330110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:55:04Z,user_data=None,user_id='6c61839790d6421c8ce129287e6dbc0b',uuid=6acef074-442c-46e9-8d68-b8826ac7c2f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converting VIF {"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lazy-loading 'pci_devices' on Instance uuid 6acef074-442c-46e9-8d68-b8826ac7c2f4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:55:06 user nova-compute[75233]:   <uuid>6acef074-442c-46e9-8d68-b8826ac7c2f4</uuid>
Dec 05 13:55:06 user nova-compute[75233]:   <name>instance-00000020</name>
Dec 05 13:55:06 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:55:06 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:55:06 user nova-compute[75233]:   <metadata>
Dec 05 13:55:06 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:55:06 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:55:06 user nova-compute[75233]:       <nova:name>tempest-ServersNegativeTestJSON-server-1363989773</nova:name>
Dec 05 13:55:06 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:55:06</nova:creationTime>
Dec 05 13:55:06 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:55:06 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:55:06 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:55:06 user nova-compute[75233]:       <nova:owner>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:user uuid="6c61839790d6421c8ce129287e6dbc0b">tempest-ServersNegativeTestJSON-1092330110-project-member</nova:user>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:project uuid="8d6981d4b1664b71b00ba32fd7ff1425">tempest-ServersNegativeTestJSON-1092330110</nova:project>
Dec 05 13:55:06 user nova-compute[75233]:       </nova:owner>
Dec 05 13:55:06 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:55:06 user nova-compute[75233]:       <nova:ports>
Dec 05 13:55:06 user nova-compute[75233]:         <nova:port uuid="d3d25588-8e21-47aa-b90a-78fb04eb9e0e">
Dec 05 13:55:06 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 13:55:06 user nova-compute[75233]:         </nova:port>
Dec 05 13:55:06 user nova-compute[75233]:       </nova:ports>
Dec 05 13:55:06 user nova-compute[75233]:     </nova:instance>
Dec 05 13:55:06 user nova-compute[75233]:   </metadata>
Dec 05 13:55:06 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:55:06 user nova-compute[75233]:     <system>
Dec 05 13:55:06 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:55:06 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:55:06 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:55:06 user nova-compute[75233]:       <entry name="serial">6acef074-442c-46e9-8d68-b8826ac7c2f4</entry>
Dec 05 13:55:06 user nova-compute[75233]:       <entry name="uuid">6acef074-442c-46e9-8d68-b8826ac7c2f4</entry>
Dec 05 13:55:06 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:55:06 user nova-compute[75233]:     </system>
Dec 05 13:55:06 user nova-compute[75233]:   </sysinfo>
Dec 05 13:55:06 user nova-compute[75233]:   <os>
Dec 05 13:55:06 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:55:06 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:55:06 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:55:06 user nova-compute[75233]:   </os>
Dec 05 13:55:06 user nova-compute[75233]:   <features>
Dec 05 13:55:06 user nova-compute[75233]:     <acpi/>
Dec 05 13:55:06 user nova-compute[75233]:     <apic/>
Dec 05 13:55:06 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:55:06 user nova-compute[75233]:   </features>
Dec 05 13:55:06 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:55:06 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:55:06 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:55:06 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:55:06 user nova-compute[75233]:   </clock>
Dec 05 13:55:06 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:55:06 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:55:06 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:55:06 user nova-compute[75233]:   </cpu>
Dec 05 13:55:06 user nova-compute[75233]:   <devices>
Dec 05 13:55:06 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:55:06 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:55:06 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk"/>
Dec 05 13:55:06 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:55:06 user nova-compute[75233]:     </disk>
Dec 05 13:55:06 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:55:06 user nova-compute[75233]:       <mac address="fa:16:3e:8a:dd:cf"/>
Dec 05 13:55:06 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:55:06 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:55:06 user nova-compute[75233]:       <target dev="tapd3d25588-8e"/>
Dec 05 13:55:06 user nova-compute[75233]:     </interface>
Dec 05 13:55:06 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:55:06 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/console.log" append="off"/>
Dec 05 13:55:06 user nova-compute[75233]:     </serial>
Dec 05 13:55:06 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:55:06 user nova-compute[75233]:     <video>
Dec 05 13:55:06 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:55:06 user nova-compute[75233]:     </video>
Dec 05 13:55:06 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:55:06 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:55:06 user nova-compute[75233]:     </rng>
Dec 05 13:55:06 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:55:06 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:55:06 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:55:06 user nova-compute[75233]:     </memballoon>
Dec 05 13:55:06 user nova-compute[75233]:   </devices>
Dec 05 13:55:06 user nova-compute[75233]: </domain>
Dec 05 13:55:06 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1363989773',display_name='tempest-ServersNegativeTestJSON-server-1363989773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1363989773',id=32,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d6981d4b1664b71b00ba32fd7ff1425',ramdisk_id='',reservation_id='r-lzwr2a0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1092330110',owner_user_name='tempest-ServersNegativeTestJSON-1092330110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:55:04Z,user_data=None,user_id='6c61839790d6421c8ce129287e6dbc0b',uuid=6acef074-442c-46e9-8d68-b8826ac7c2f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converting VIF {"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG os_vif [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60c623b5-93d7-5a04-8496-2684d2c3646f', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d25588-8e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3d25588-8e, col_values=(('qos', UUID('e52de50b-bc3d-4d8a-98a6-75ca4989c430')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3d25588-8e, col_values=(('external_ids', {'iface-id': 'd3d25588-8e21-47aa-b90a-78fb04eb9e0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:dd:cf', 'vm-uuid': '6acef074-442c-46e9-8d68-b8826ac7c2f4'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:06 user nova-compute[75233]: INFO os_vif [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e')
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] No VIF found with MAC fa:16:3e:8a:dd:cf, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Updated VIF entry in instance network info cache for port d3d25588-8e21-47aa-b90a-78fb04eb9e0e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Updating instance_info_cache with network_info: [{"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b42b0992-3a8a-4bef-89cf-4c52e4a76487 req-681c8a5c-5027-4b90-aa92-532f8bd89dfc service nova] Releasing lock "refresh_cache-6acef074-442c-46e9-8d68-b8826ac7c2f4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-0dc63b66-d1e1-4eb4-a5a6-7c67b3e44e6d req-887b5a77-ee60-4a05-9a26-d994dacab667 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0dc63b66-d1e1-4eb4-a5a6-7c67b3e44e6d req-887b5a77-ee60-4a05-9a26-d994dacab667 service nova] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0dc63b66-d1e1-4eb4-a5a6-7c67b3e44e6d req-887b5a77-ee60-4a05-9a26-d994dacab667 service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0dc63b66-d1e1-4eb4-a5a6-7c67b3e44e6d req-887b5a77-ee60-4a05-9a26-d994dacab667 service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-0dc63b66-d1e1-4eb4-a5a6-7c67b3e44e6d req-887b5a77-ee60-4a05-9a26-d994dacab667 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] No waiting events found dispatching network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:08 user nova-compute[75233]: WARNING nova.compute.manager [req-0dc63b66-d1e1-4eb4-a5a6-7c67b3e44e6d req-887b5a77-ee60-4a05-9a26-d994dacab667 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received unexpected event network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e for instance with vm_state building and task_state spawning.
Dec 05 13:55:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:09 user nova-compute[75233]: INFO nova.compute.manager [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Detaching volume d757ec1c-8de1-44ab-b7f5-76bb27d40a9c
Dec 05 13:55:09 user nova-compute[75233]: INFO nova.virt.block_device [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attempting to driver detach volume d757ec1c-8de1-44ab-b7f5-76bb27d40a9c from mountpoint /dev/vdb
Dec 05 13:55:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Attempting to detach device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:55:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:55:09 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:55:09 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:55:09 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:55:09 user nova-compute[75233]:   <serial>d757ec1c-8de1-44ab-b7f5-76bb27d40a9c</serial>
Dec 05 13:55:09 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:55:09 user nova-compute[75233]: </disk>
Dec 05 13:55:09 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:55:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config.
Dec 05 13:55:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:55:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:55:09 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:55:09 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:55:09 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:55:09 user nova-compute[75233]:   <serial>d757ec1c-8de1-44ab-b7f5-76bb27d40a9c</serial>
Dec 05 13:55:09 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:55:09 user nova-compute[75233]: </disk>
Dec 05 13:55:09 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:55:10 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Instance spawned successfully.
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:10 user nova-compute[75233]: INFO nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Took 6.13 seconds to spawn the instance on the hypervisor.
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-dda4be3e-8339-490f-aa62-a34fbff68cfa req-a227fb6a-2fbd-4ff2-ae0e-08f6c28b10c5 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dda4be3e-8339-490f-aa62-a34fbff68cfa req-a227fb6a-2fbd-4ff2-ae0e-08f6c28b10c5 service nova] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dda4be3e-8339-490f-aa62-a34fbff68cfa req-a227fb6a-2fbd-4ff2-ae0e-08f6c28b10c5 service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dda4be3e-8339-490f-aa62-a34fbff68cfa req-a227fb6a-2fbd-4ff2-ae0e-08f6c28b10c5 service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-dda4be3e-8339-490f-aa62-a34fbff68cfa req-a227fb6a-2fbd-4ff2-ae0e-08f6c28b10c5 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] No waiting events found dispatching network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:10 user nova-compute[75233]: WARNING nova.compute.manager [req-dda4be3e-8339-490f-aa62-a34fbff68cfa req-a227fb6a-2fbd-4ff2-ae0e-08f6c28b10c5 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received unexpected event network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e for instance with vm_state building and task_state spawning.
Dec 05 13:55:10 user nova-compute[75233]: INFO nova.compute.manager [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Took 6.95 seconds to build instance.
Dec 05 13:55:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f9c049eb-a198-44f9-8a31-6fab4397970b tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.038s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:55:20 user nova-compute[75233]: INFO nova.compute.claims [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Claim successful on node user
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:55:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:55:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:55:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Creating image(s)
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "/opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "/opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "/opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.policy [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6a3445087d842fc9279e2472759bf1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14235050c7d84ebb8ff12ff245c35fec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk 1073741824" returned: 0 in 0.050s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Successfully created port: 6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Cannot resize image /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Ensure instance console log exists: /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Successfully updated port: 6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquired lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-changed-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Refreshing instance network info cache due to event network-changed-6f867925-1c09-4a2a-9307-07c5a473ae74. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] Acquiring lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updating instance_info_cache with network_info: [{"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Releasing lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Instance network_info: |[{"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] Acquired lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Refreshing network info cache for port 6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Start _get_guest_xml network_info=[{"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:55:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:55:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710911232',display_name='tempest-AttachVolumeTestJSON-server-1710911232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710911232',id=33,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG7XW+Y7GaDKokWwropXez/5XzsRmyYTRZFAmzrOrR7Sjt+UZTwSYT2pjKs8R1fdaMWBtZcA5/CqOC0IFKStNJ4u/qlRin3a6cecyefNgnGYcXJ4zyqiDLyUCBgJPqTQw==',key_name='tempest-keypair-223770753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-y4ast2e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=965d565d-b95b-4374-b28e-4a8180f4a702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.objects.instance [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'pci_devices' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:55:22 user nova-compute[75233]:   <uuid>965d565d-b95b-4374-b28e-4a8180f4a702</uuid>
Dec 05 13:55:22 user nova-compute[75233]:   <name>instance-00000021</name>
Dec 05 13:55:22 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:55:22 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:55:22 user nova-compute[75233]:   <metadata>
Dec 05 13:55:22 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:55:22 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:55:22 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeTestJSON-server-1710911232</nova:name>
Dec 05 13:55:22 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:55:22</nova:creationTime>
Dec 05 13:55:22 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:55:22 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:55:22 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:55:22 user nova-compute[75233]:       <nova:owner>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:user uuid="a6a3445087d842fc9279e2472759bf1f">tempest-AttachVolumeTestJSON-1807043870-project-member</nova:user>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:project uuid="14235050c7d84ebb8ff12ff245c35fec">tempest-AttachVolumeTestJSON-1807043870</nova:project>
Dec 05 13:55:22 user nova-compute[75233]:       </nova:owner>
Dec 05 13:55:22 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:55:22 user nova-compute[75233]:       <nova:ports>
Dec 05 13:55:22 user nova-compute[75233]:         <nova:port uuid="6f867925-1c09-4a2a-9307-07c5a473ae74">
Dec 05 13:55:22 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 13:55:22 user nova-compute[75233]:         </nova:port>
Dec 05 13:55:22 user nova-compute[75233]:       </nova:ports>
Dec 05 13:55:22 user nova-compute[75233]:     </nova:instance>
Dec 05 13:55:22 user nova-compute[75233]:   </metadata>
Dec 05 13:55:22 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:55:22 user nova-compute[75233]:     <system>
Dec 05 13:55:22 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:55:22 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:55:22 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:55:22 user nova-compute[75233]:       <entry name="serial">965d565d-b95b-4374-b28e-4a8180f4a702</entry>
Dec 05 13:55:22 user nova-compute[75233]:       <entry name="uuid">965d565d-b95b-4374-b28e-4a8180f4a702</entry>
Dec 05 13:55:22 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:55:22 user nova-compute[75233]:     </system>
Dec 05 13:55:22 user nova-compute[75233]:   </sysinfo>
Dec 05 13:55:22 user nova-compute[75233]:   <os>
Dec 05 13:55:22 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:55:22 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:55:22 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:55:22 user nova-compute[75233]:   </os>
Dec 05 13:55:22 user nova-compute[75233]:   <features>
Dec 05 13:55:22 user nova-compute[75233]:     <acpi/>
Dec 05 13:55:22 user nova-compute[75233]:     <apic/>
Dec 05 13:55:22 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:55:22 user nova-compute[75233]:   </features>
Dec 05 13:55:22 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:55:22 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:55:22 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:55:22 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:55:22 user nova-compute[75233]:   </clock>
Dec 05 13:55:22 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:55:22 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:55:22 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:55:22 user nova-compute[75233]:   </cpu>
Dec 05 13:55:22 user nova-compute[75233]:   <devices>
Dec 05 13:55:22 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:55:22 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:55:22 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk"/>
Dec 05 13:55:22 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:55:22 user nova-compute[75233]:     </disk>
Dec 05 13:55:22 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:55:22 user nova-compute[75233]:       <mac address="fa:16:3e:31:ef:04"/>
Dec 05 13:55:22 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:55:22 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:55:22 user nova-compute[75233]:       <target dev="tap6f867925-1c"/>
Dec 05 13:55:22 user nova-compute[75233]:     </interface>
Dec 05 13:55:22 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:55:22 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/console.log" append="off"/>
Dec 05 13:55:22 user nova-compute[75233]:     </serial>
Dec 05 13:55:22 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:55:22 user nova-compute[75233]:     <video>
Dec 05 13:55:22 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:55:22 user nova-compute[75233]:     </video>
Dec 05 13:55:22 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:55:22 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:55:22 user nova-compute[75233]:     </rng>
Dec 05 13:55:22 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:55:22 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:55:22 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:55:22 user nova-compute[75233]:     </memballoon>
Dec 05 13:55:22 user nova-compute[75233]:   </devices>
Dec 05 13:55:22 user nova-compute[75233]: </domain>
Dec 05 13:55:22 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710911232',display_name='tempest-AttachVolumeTestJSON-server-1710911232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710911232',id=33,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG7XW+Y7GaDKokWwropXez/5XzsRmyYTRZFAmzrOrR7Sjt+UZTwSYT2pjKs8R1fdaMWBtZcA5/CqOC0IFKStNJ4u/qlRin3a6cecyefNgnGYcXJ4zyqiDLyUCBgJPqTQw==',key_name='tempest-keypair-223770753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-y4ast2e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=965d565d-b95b-4374-b28e-4a8180f4a702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG os_vif [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7263663-8d3f-500e-b709-c4bd147d70ec', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f867925-1c, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f867925-1c, col_values=(('qos', UUID('94527438-2918-47d9-93ab-77c5ba92cc80')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f867925-1c, col_values=(('external_ids', {'iface-id': '6f867925-1c09-4a2a-9307-07c5a473ae74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:ef:04', 'vm-uuid': '965d565d-b95b-4374-b28e-4a8180f4a702'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:22 user nova-compute[75233]: INFO os_vif [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c')
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:55:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No VIF found with MAC fa:16:3e:31:ef:04, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:55:23 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updated VIF entry in instance network info cache for port 6f867925-1c09-4a2a-9307-07c5a473ae74. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:55:23 user nova-compute[75233]: DEBUG nova.network.neutron [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updating instance_info_cache with network_info: [{"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6a514044-1f9d-47ae-870a-cc0e65cf68ef req-1b0283c3-f97c-45be-bf05-e965cc0a484d service nova] Releasing lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-16bebecd-20e7-49dc-bc16-a2ac92a155ca req-5d8f02ae-ee59-4051-89e7-73df3a086783 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-16bebecd-20e7-49dc-bc16-a2ac92a155ca req-5d8f02ae-ee59-4051-89e7-73df3a086783 service nova] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-16bebecd-20e7-49dc-bc16-a2ac92a155ca req-5d8f02ae-ee59-4051-89e7-73df3a086783 service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-16bebecd-20e7-49dc-bc16-a2ac92a155ca req-5d8f02ae-ee59-4051-89e7-73df3a086783 service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-16bebecd-20e7-49dc-bc16-a2ac92a155ca req-5d8f02ae-ee59-4051-89e7-73df3a086783 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] No waiting events found dispatching network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:24 user nova-compute[75233]: WARNING nova.compute.manager [req-16bebecd-20e7-49dc-bc16-a2ac92a155ca req-5d8f02ae-ee59-4051-89e7-73df3a086783 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received unexpected event network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 for instance with vm_state building and task_state spawning.
Dec 05 13:55:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:55:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Instance spawned successfully.
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:55:26 user nova-compute[75233]: INFO nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Took 5.17 seconds to spawn the instance on the hypervisor.
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:55:26 user nova-compute[75233]: INFO nova.compute.manager [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Took 5.92 seconds to build instance.
Dec 05 13:55:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-95a0d071-04f6-48f8-b032-cd59b08f2b42 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.012s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-91ef283f-8f0c-4747-ba2e-92da7ad3f68f req-d4ef6748-ed27-4472-8ab2-40b2d92d5675 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-91ef283f-8f0c-4747-ba2e-92da7ad3f68f req-d4ef6748-ed27-4472-8ab2-40b2d92d5675 service nova] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-91ef283f-8f0c-4747-ba2e-92da7ad3f68f req-d4ef6748-ed27-4472-8ab2-40b2d92d5675 service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-91ef283f-8f0c-4747-ba2e-92da7ad3f68f req-d4ef6748-ed27-4472-8ab2-40b2d92d5675 service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-91ef283f-8f0c-4747-ba2e-92da7ad3f68f req-d4ef6748-ed27-4472-8ab2-40b2d92d5675 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] No waiting events found dispatching network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:26 user nova-compute[75233]: WARNING nova.compute.manager [req-91ef283f-8f0c-4747-ba2e-92da7ad3f68f req-d4ef6748-ed27-4472-8ab2-40b2d92d5675 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received unexpected event network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 for instance with vm_state active and task_state None.
Dec 05 13:55:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e is timed out.
Dec 05 13:55:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config.
Dec 05 13:55:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyeDzaXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:55:30 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e3d7f-8fb5-4bef-9451-dd0bbb0c0138]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:55:30 user nova-compute[75233]: No targets found.
Dec 05 13:55:30 user nova-compute[75233]: iSNS:
Dec 05 13:55:30 user nova-compute[75233]: No targets found.
Dec 05 13:55:30 user nova-compute[75233]: STATIC:
Dec 05 13:55:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:55:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:55:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:55:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c
Dec 05 13:55:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:55:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:55:30 user nova-compute[75233]: FIRMWARE:
Dec 05 13:55:30 user nova-compute[75233]: No targets found.
Dec 05 13:55:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:55:30 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:55:30 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916dab8-84b9-4794-b42e-e81b0e89c71c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8cf9cd-da36-4c82-a605-8db7ab0c85d1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:55:30 user nova-compute[75233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c (non-flash)
Dec 05 13:55:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:55:30 user nova-compute[75233]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c (non-flash)
Dec 05 13:55:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586a8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3213b186-995a-4033-aafd-a22d2d9c85bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe361f-3228-489b-943f-198c15d12714]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c859f532-3daa-45ca-a1e1-62ed32267029]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49763d3-9d9a-4865-9821-633706fff97d]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[973366d1-6fb4-4b52-b933-18e01e456b3f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65b4d6-70c9-4a46-89dd-a04c1ea5dbe3]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260]
Dec 05 13:55:30 user nova-compute[75233]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c, portal: 172.16.0.220,3260] successful.
Dec 05 13:55:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d757ec1c-8de1-44ab-b7f5-76bb27d40a9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eb5f57-4286-423c-9330-35dd59660f1b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== disconnect_volume: return (293ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:55:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-4adac0c0-f64a-48df-9348-f237a085bfea tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid bda94a77-e19a-4ea0-88ca-19c86689cd0b {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 3f5b5067-5f96-48a8-a6da-7630b1a972d6 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 05d8a032-7b26-4106-afe5-4bc5b811388a {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 6acef074-442c-46e9-8d68-b8826ac7c2f4 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:40 user nova-compute[75233]: INFO nova.compute.manager [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Unshelving
Dec 05 13:55:40 user nova-compute[75233]: INFO nova.virt.block_device [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Booting with volume 4c688f24-405b-45d5-aaa3-25de31b3ce25 at /dev/vda
Dec 05 13:55:40 user nova-compute[75233]: DEBUG os_brick.utils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ea2f42-03a7-48eb-8fae-2d1be83c945a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24170a04-5197-4135-bf78-d10fcea85eff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a2484-808f-4b9c-b2e3-6e9902232d29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef10fd7-1745-41bb-9bcd-b9ceba521c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:55:41 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35a823-c9b9-4d66-a284-7982c343fdd9]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG os_brick.utils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating existing volume attachment record: 31cef0fa-f330-4184-a42b-cc32add5fae9 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:41 user nova-compute[75233]: INFO nova.compute.manager [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Terminating instance
Dec 05 13:55:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-b8c07364-87c9-4b78-9bb3-2ad92533205d req-d93eb383-c1ec-4ede-a249-cfa64e11a386 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b8c07364-87c9-4b78-9bb3-2ad92533205d req-d93eb383-c1ec-4ede-a249-cfa64e11a386 service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b8c07364-87c9-4b78-9bb3-2ad92533205d req-d93eb383-c1ec-4ede-a249-cfa64e11a386 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b8c07364-87c9-4b78-9bb3-2ad92533205d req-d93eb383-c1ec-4ede-a249-cfa64e11a386 service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-b8c07364-87c9-4b78-9bb3-2ad92533205d req-d93eb383-c1ec-4ede-a249-cfa64e11a386 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-b8c07364-87c9-4b78-9bb3-2ad92533205d req-d93eb383-c1ec-4ede-a249-cfa64e11a386 service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-unplugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:55:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Instance destroyed successfully.
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.objects.instance [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lazy-loading 'resources' on Instance uuid 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478206480',display_name='tempest-ServerRescueNegativeTestJSON-server-478206480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-478206480',id=1,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b7c3d1e9a7462b8c4833174777873e',ramdisk_id='',reservation_id='r-p8zaf510',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2142653953',owner_user_name='tempest-ServerRescueNegativeTestJSON-2142653953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:45:22Z,user_data=None,user_id='e7ddf7a828a547e9b606ed9e8e8727eb',uuid=2bec11aa-9bc8-4724-8d1c-1dd2aa813dda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converting VIF {"id": "452eceed-ab34-4c46-9122-6f289fcc7597", "address": "fa:16:3e:d5:95:cc", "network": {"id": "0dc9b360-5377-4820-acdc-a49ebb3dd47b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1870474550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b7c3d1e9a7462b8c4833174777873e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap452eceed-ab", "ovs_interfaceid": "452eceed-ab34-4c46-9122-6f289fcc7597", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG os_vif [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap452eceed-ab, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=388711ea-d83c-4fee-b79c-ecbd50019c8a) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:42 user nova-compute[75233]: INFO os_vif [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:cc,bridge_name='br-int',has_traffic_filtering=True,id=452eceed-ab34-4c46-9122-6f289fcc7597,network=Network(0dc9b360-5377-4820-acdc-a49ebb3dd47b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap452eceed-ab')
Dec 05 13:55:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Deleting instance files /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda_del
Dec 05 13:55:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Deletion of /opt/stack/data/nova/instances/2bec11aa-9bc8-4724-8d1c-1dd2aa813dda_del complete
Dec 05 13:55:42 user nova-compute[75233]: INFO nova.compute.manager [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 13:55:42 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:55:42 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:55:43 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:43 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Took 0.52 seconds to deallocate network for instance.
Dec 05 13:55:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:55:43 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:55:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:43 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Deleted allocations for instance 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda
Dec 05 13:55:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be7fe667-c97a-4a68-a86d-cfc1849fba62 tempest-ServerRescueNegativeTestJSON-2142653953 tempest-ServerRescueNegativeTestJSON-2142653953-project-member] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.924s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] Acquiring lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] Lock "2bec11aa-9bc8-4724-8d1c-1dd2aa813dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] No waiting events found dispatching network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:44 user nova-compute[75233]: WARNING nova.compute.manager [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received unexpected event network-vif-plugged-452eceed-ab34-4c46-9122-6f289fcc7597 for instance with vm_state deleted and task_state None.
Dec 05 13:55:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-65a99fc7-2b4c-4edb-b8b1-b2afcedaa0ec req-76635dbc-1ea6-4203-881f-cca7f6a7ee8b service nova] [instance: 2bec11aa-9bc8-4724-8d1c-1dd2aa813dda] Received event network-vif-deleted-452eceed-ab34-4c46-9122-6f289fcc7597 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'pci_requests' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'numa_topology' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:55:50 user nova-compute[75233]: INFO nova.compute.claims [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Claim successful on node user
Dec 05 13:55:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:55:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:50 user nova-compute[75233]: INFO nova.network.neutron [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating port 49f84095-c600-4bd3-9e7f-12ef0ab68924 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:55:51 user nova-compute[75233]: INFO nova.compute.claims [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Claim successful on node user
Dec 05 13:55:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:55:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:55:51 user nova-compute[75233]: DEBUG nova.policy [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5414614ea59f4b26938bf55a492e5ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405f4ac4b28d405fb6f71f29c6557517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:55:51 user nova-compute[75233]: INFO nova.virt.block_device [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Booting with volume 9e8c7f28-31bb-4a30-91a5-36157799bcf4 at /dev/vda
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.utils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de7cf3-8f61-45a3-b2f1-39cc0bb70957]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a6c72-4844-42a9-98f7-c6845bdeacb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing instance network info cache due to event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcc1dd9-3eea-4bd5-aff0-256a80bf80cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b62eab-e872-4431-aa12-e46e287d5794]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:55:52 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae939116-ad2e-4b42-bcec-ed737595f11b]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.utils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating existing volume attachment record: 079614b8-5629-4b2f-9834-a3ef4541a739 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:55:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Creating image(s)
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Start _get_guest_xml network_info=[{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a83ef82d-ed7f-41e7-8666-f74b251c1ce2', 'attached_at': '', 'detached_at': '', 'volume_id': '4c688f24-405b-45d5-aaa3-25de31b3ce25', 'serial': '4c688f24-405b-45d5-aaa3-25de31b3ce25'}, 'delete_on_termination': True, 'attachment_id': '31cef0fa-f330-4184-a42b-cc32add5fae9', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.network.neutron [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:55:52 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:55:52 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'vcpu_model' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.objects.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Object Instance<a83ef82d-ed7f-41e7-8666-f74b251c1ce2> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:55:52 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:55:52 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:55:52 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69bfa0a-20a8-4af9-ab3b-2a0b780de03a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:55:52 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG nova.network.neutron [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Successfully created port: 021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5162c07-0a91-4257-802a-010eea6a94c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25] added
Dec 05 13:55:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb0ba6a-5233-45fd-b6d6-52deeadd888d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ed2e8-71f6-46f8-85a4-062f1e15ab05]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFxAJXsm {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFxAJXsm" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ab2e8-27b4-45df-a2ff-4df8c3254210]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFxAJXsm'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa9d751-4133-4131-9c2a-c2205d83acbc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37368bb-afd1-4c8d-bca8-b7f035df990d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:55:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:55:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc67fe72-a059-4b9c-81aa-06b56abe3650]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]
Dec 05 13:55:52 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.
Dec 05 13:55:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b1f330-9e05-4aa6-9a1c-b7493412764b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c3c40f-5664-4290-bc3e-e3dada15de2a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:55:52 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:55:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:55:52 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:55:52 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d75cdf-1f0f-414a-b088-69826e769270]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:55:52 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updated VIF entry in instance network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c629e731-0b28-4b6e-b87e-4812e62065e5 req-5a9f95e7-0cfc-46fb-9e13-5ee83b2748a5 service nova] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Successfully updated port: 021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquired lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-changed-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Refreshing instance network info cache due to event network-changed-021bf74e-59c6-4e5b-92f0-5c75b594384e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] Acquiring lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Releasing lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance network_info: |[{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] Acquired lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Refreshing network info cache for port 021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23332333761396139', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332333761396139', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960902112',display_name='tempest-TestShelveInstance-server-1960902112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960902112',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2054970852',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:52:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c4ab64efbb5940c4a62331f4fce76a62',ramdisk_id='',reservation_id='r-j50rbkmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1187931716',owner_user_name='tempest-TestShelveInstance-1187931716-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:55:41Z,user_data=None,user_id='a35a118fda664fe5a60df4a41ea7dc05',uuid=a83ef82d-ed7f-41e7-8666-f74b251c1ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converting VIF {"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'pci_devices' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.objects.base [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Object Instance<a83ef82d-ed7f-41e7-8666-f74b251c1ce2> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:55:53 user nova-compute[75233]:   <uuid>a83ef82d-ed7f-41e7-8666-f74b251c1ce2</uuid>
Dec 05 13:55:53 user nova-compute[75233]:   <name>instance-0000001b</name>
Dec 05 13:55:53 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:55:53 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:55:53 user nova-compute[75233]:   <metadata>
Dec 05 13:55:53 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:55:53 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:55:53 user nova-compute[75233]:       <nova:name>tempest-TestShelveInstance-server-1960902112</nova:name>
Dec 05 13:55:53 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:55:52</nova:creationTime>
Dec 05 13:55:53 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:55:53 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:55:53 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:55:53 user nova-compute[75233]:       <nova:owner>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:user uuid="a35a118fda664fe5a60df4a41ea7dc05">tempest-TestShelveInstance-1187931716-project-member</nova:user>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:project uuid="c4ab64efbb5940c4a62331f4fce76a62">tempest-TestShelveInstance-1187931716</nova:project>
Dec 05 13:55:53 user nova-compute[75233]:       </nova:owner>
Dec 05 13:55:53 user nova-compute[75233]:       <nova:ports>
Dec 05 13:55:53 user nova-compute[75233]:         <nova:port uuid="49f84095-c600-4bd3-9e7f-12ef0ab68924">
Dec 05 13:55:53 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 13:55:53 user nova-compute[75233]:         </nova:port>
Dec 05 13:55:53 user nova-compute[75233]:       </nova:ports>
Dec 05 13:55:53 user nova-compute[75233]:     </nova:instance>
Dec 05 13:55:53 user nova-compute[75233]:   </metadata>
Dec 05 13:55:53 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:55:53 user nova-compute[75233]:     <system>
Dec 05 13:55:53 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:55:53 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:55:53 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:55:53 user nova-compute[75233]:       <entry name="serial">a83ef82d-ed7f-41e7-8666-f74b251c1ce2</entry>
Dec 05 13:55:53 user nova-compute[75233]:       <entry name="uuid">a83ef82d-ed7f-41e7-8666-f74b251c1ce2</entry>
Dec 05 13:55:53 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:55:53 user nova-compute[75233]:     </system>
Dec 05 13:55:53 user nova-compute[75233]:   </sysinfo>
Dec 05 13:55:53 user nova-compute[75233]:   <os>
Dec 05 13:55:53 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:55:53 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:55:53 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:55:53 user nova-compute[75233]:   </os>
Dec 05 13:55:53 user nova-compute[75233]:   <features>
Dec 05 13:55:53 user nova-compute[75233]:     <acpi/>
Dec 05 13:55:53 user nova-compute[75233]:     <apic/>
Dec 05 13:55:53 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:55:53 user nova-compute[75233]:   </features>
Dec 05 13:55:53 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:55:53 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:55:53 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:55:53 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:55:53 user nova-compute[75233]:   </clock>
Dec 05 13:55:53 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:55:53 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:55:53 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:55:53 user nova-compute[75233]:   </cpu>
Dec 05 13:55:53 user nova-compute[75233]:   <devices>
Dec 05 13:55:53 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:55:53 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:55:53 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 13:55:53 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:55:53 user nova-compute[75233]:       <serial>4c688f24-405b-45d5-aaa3-25de31b3ce25</serial>
Dec 05 13:55:53 user nova-compute[75233]:     </disk>
Dec 05 13:55:53 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:55:53 user nova-compute[75233]:       <mac address="fa:16:3e:e2:e5:50"/>
Dec 05 13:55:53 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:55:53 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:55:53 user nova-compute[75233]:       <target dev="tap49f84095-c6"/>
Dec 05 13:55:53 user nova-compute[75233]:     </interface>
Dec 05 13:55:53 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:55:53 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2/console.log" append="off"/>
Dec 05 13:55:53 user nova-compute[75233]:     </serial>
Dec 05 13:55:53 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:55:53 user nova-compute[75233]:     <video>
Dec 05 13:55:53 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:55:53 user nova-compute[75233]:     </video>
Dec 05 13:55:53 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:55:53 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:55:53 user nova-compute[75233]:     </rng>
Dec 05 13:55:53 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:55:53 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:55:53 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:55:53 user nova-compute[75233]:     </memballoon>
Dec 05 13:55:53 user nova-compute[75233]:   </devices>
Dec 05 13:55:53 user nova-compute[75233]: </domain>
Dec 05 13:55:53 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960902112',display_name='tempest-TestShelveInstance-server-1960902112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960902112',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2054970852',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:52:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c4ab64efbb5940c4a62331f4fce76a62',ramdisk_id='',reservation_id='r-j50rbkmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1187931716',owner_user_name='tempest-TestShelveInstance-1187931716-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:55:41Z,user_data=None,user_id='a35a118fda664fe5a60df4a41ea7dc05',uuid=a83ef82d-ed7f-41e7-8666-f74b251c1ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converting VIF {"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG os_vif [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a1be18f-ea20-5628-b442-e8ee19687fd6', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49f84095-c6, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49f84095-c6, col_values=(('qos', UUID('277a091a-28ad-4c85-857e-c64ec05317c0')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49f84095-c6, col_values=(('external_ids', {'iface-id': '49f84095-c600-4bd3-9e7f-12ef0ab68924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e5:50', 'vm-uuid': 'a83ef82d-ed7f-41e7-8666-f74b251c1ce2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:53 user nova-compute[75233]: INFO os_vif [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6')
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-changed-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Refreshing instance network info cache due to event network-changed-5e78e3e1-5892-426d-a2df-b51cb27fa899. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] Acquiring lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] Acquired lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:55:53 user nova-compute[75233]: DEBUG nova.network.neutron [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Refreshing network info cache for port 5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] No VIF found with MAC fa:16:3e:e2:e5:50, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG nova.network.neutron [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updated VIF entry in instance network info cache for port 021bf74e-59c6-4e5b-92f0-5c75b594384e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG nova.network.neutron [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1c568445-06e5-4803-b405-6050aee385bb req-38516ea9-0f18-47c6-9571-bec2ac65a9e5 service nova] Releasing lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG nova.network.neutron [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updated VIF entry in instance network info cache for port 5e78e3e1-5892-426d-a2df-b51cb27fa899. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG nova.network.neutron [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updating instance_info_cache with network_info: [{"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:55:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-af4224e3-9661-486e-b8ff-fd74edea83a0 req-59773c5e-446f-4923-b5ed-73c5f44e9b6e service nova] Releasing lock "refresh_cache-eabd1057-003a-4b46-9fa1-1378b4f7388b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-9e28ab4d-1492-4d4d-ae47-93a82d612bb9 req-4d61d0d9-a7ef-43b1-9c40-4ab69dab20d8 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9e28ab4d-1492-4d4d-ae47-93a82d612bb9 req-4d61d0d9-a7ef-43b1-9c40-4ab69dab20d8 service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9e28ab4d-1492-4d4d-ae47-93a82d612bb9 req-4d61d0d9-a7ef-43b1-9c40-4ab69dab20d8 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9e28ab4d-1492-4d4d-ae47-93a82d612bb9 req-4d61d0d9-a7ef-43b1-9c40-4ab69dab20d8 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-9e28ab4d-1492-4d4d-ae47-93a82d612bb9 req-4d61d0d9-a7ef-43b1-9c40-4ab69dab20d8 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:55 user nova-compute[75233]: WARNING nova.compute.manager [req-9e28ab4d-1492-4d4d-ae47-93a82d612bb9 req-4d61d0d9-a7ef-43b1-9c40-4ab69dab20d8 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:55:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:56 user nova-compute[75233]: INFO nova.compute.manager [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Attaching volume a5cb4d7f-65b8-45a6-aa75-8aff61962e26 to /dev/vdb
Dec 05 13:55:56 user nova-compute[75233]: DEBUG os_brick.utils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf41ebb-31d4-4815-a317-a52ef41c00c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46b4ad2-75b1-4483-8622-1fd350b982a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3622afe5-b770-4a41-a27c-4b882dc563b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5e1c98-4058-4ea9-9205-f6159c19ac13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:55:56 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:55:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2cf1c-f5bb-4863-a30a-86b40f1273d4]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG os_brick.utils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:55:56 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updating existing volume attachment record: 1cbc637c-87d9-4c9d-9258-52c2b93dc174 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:55:57 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance spawned successfully.
Dec 05 13:55:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b1fac3c4-550b-4e1c-bdc0-5e95478ee3e3 tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.756s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-421642d9-68d8-4be8-84aa-6b773f1abb87 req-e87e8601-3df0-4e73-baea-70a4bcd627b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-421642d9-68d8-4be8-84aa-6b773f1abb87 req-e87e8601-3df0-4e73-baea-70a4bcd627b9 service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-421642d9-68d8-4be8-84aa-6b773f1abb87 req-e87e8601-3df0-4e73-baea-70a4bcd627b9 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-421642d9-68d8-4be8-84aa-6b773f1abb87 req-e87e8601-3df0-4e73-baea-70a4bcd627b9 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-421642d9-68d8-4be8-84aa-6b773f1abb87 req-e87e8601-3df0-4e73-baea-70a4bcd627b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:55:57 user nova-compute[75233]: WARNING nova.compute.manager [req-421642d9-68d8-4be8-84aa-6b773f1abb87 req-e87e8601-3df0-4e73-baea-70a4bcd627b9 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state active and task_state None.
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:55:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:01 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:56:01 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=24.988414764404297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance eabd1057-003a-4b46-9fa1-1378b4f7388b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 6acef074-442c-46e9-8d68-b8826ac7c2f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 965d565d-b95b-4374-b28e-4a8180f4a702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a83ef82d-ed7f-41e7-8666-f74b251c1ce2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:56:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:56:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Creating image(s)
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Ensure instance console log exists: /opt/stack/data/nova/instances/11fe694c-476e-465f-8b23-f8e2bffd7938/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Start _get_guest_xml network_info=[{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11fe694c-476e-465f-8b23-f8e2bffd7938', 'attached_at': '', 'detached_at': '', 'volume_id': '9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'serial': '9e8c7f28-31bb-4a30-91a5-36157799bcf4'}, 'delete_on_termination': True, 'attachment_id': '079614b8-5629-4b2f-9834-a3ef4541a739', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:56:02 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:56:02 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:56:02 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:02 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:02 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c12b07-e0e2-42db-b7fe-dd98c63bb511]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:56:02 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a3bc91-d3e4-4630-b7ae-62ce1b15769f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4] added
Dec 05 13:56:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aa88c0-adec-43fc-84a9-6fa7e42da0d8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[818cf041-1f65-4e86-a02c-6a6f25d05001]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ampsTHiq {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG nova.objects.instance [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ampsTHiq" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9659820-b321-4ada-bac0-316093c6824f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ampsTHiq'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.059s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8cba9-5298-4ab5-9276-9cfb8fd379b6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6357fde5-7f26-4206-8b02-9d3f17ffe044]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:02 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:02 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.156s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a1169-0a4b-4c44-8358-00feec578a38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]
Dec 05 13:56:02 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.
Dec 05 13:56:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[963f60c9-57fe-44fa-b66b-ece9bf591148]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[292cf151-8fb5-4a41-83eb-2dae394a735d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:02 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:02 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:02 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:02 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca380b8d-1eb1-46d2-9eaf-3e84223429aa]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:02 user nova-compute[75233]: INFO nova.compute.manager [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attaching volume 30042a00-cf53-4972-9176-2718605f4da6 to /dev/vdb
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.utils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9fefb4-8caf-4309-b229-af44e26f70f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb678fa-a738-42d0-95de-fa6e6fc9fdc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b575c1c-8a5d-4a9b-bf03-492827705b4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e27a91b-a81a-478d-a60e-b5cf462e98d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:56:03 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:56:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db57fb5-c6d5-4e66-b19a-430c484d8a85]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.utils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating existing volume attachment record: 29e972d6-8997-475b-80a5-50d39f44b3d6 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26433663636636463', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433663636636463', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911532962',display_name='tempest-ServerActionsTestOtherA-server-911532962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911532962',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-l7i7d47w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=11fe694c-476e-465f-8b23-f8e2bffd7938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:56:03 user nova-compute[75233]: DEBUG nova.objects.instance [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'pci_devices' on Instance uuid 11fe694c-476e-465f-8b23-f8e2bffd7938 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:56:04 user nova-compute[75233]:   <uuid>11fe694c-476e-465f-8b23-f8e2bffd7938</uuid>
Dec 05 13:56:04 user nova-compute[75233]:   <name>instance-00000022</name>
Dec 05 13:56:04 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:56:04 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:56:04 user nova-compute[75233]:   <metadata>
Dec 05 13:56:04 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:56:04 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:56:04 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherA-server-911532962</nova:name>
Dec 05 13:56:04 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:56:02</nova:creationTime>
Dec 05 13:56:04 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:56:04 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:56:04 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:56:04 user nova-compute[75233]:       <nova:owner>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:user uuid="5414614ea59f4b26938bf55a492e5ddd">tempest-ServerActionsTestOtherA-875899137-project-member</nova:user>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:project uuid="405f4ac4b28d405fb6f71f29c6557517">tempest-ServerActionsTestOtherA-875899137</nova:project>
Dec 05 13:56:04 user nova-compute[75233]:       </nova:owner>
Dec 05 13:56:04 user nova-compute[75233]:       <nova:ports>
Dec 05 13:56:04 user nova-compute[75233]:         <nova:port uuid="021bf74e-59c6-4e5b-92f0-5c75b594384e">
Dec 05 13:56:04 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 13:56:04 user nova-compute[75233]:         </nova:port>
Dec 05 13:56:04 user nova-compute[75233]:       </nova:ports>
Dec 05 13:56:04 user nova-compute[75233]:     </nova:instance>
Dec 05 13:56:04 user nova-compute[75233]:   </metadata>
Dec 05 13:56:04 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:56:04 user nova-compute[75233]:     <system>
Dec 05 13:56:04 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:56:04 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:56:04 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:56:04 user nova-compute[75233]:       <entry name="serial">11fe694c-476e-465f-8b23-f8e2bffd7938</entry>
Dec 05 13:56:04 user nova-compute[75233]:       <entry name="uuid">11fe694c-476e-465f-8b23-f8e2bffd7938</entry>
Dec 05 13:56:04 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:56:04 user nova-compute[75233]:     </system>
Dec 05 13:56:04 user nova-compute[75233]:   </sysinfo>
Dec 05 13:56:04 user nova-compute[75233]:   <os>
Dec 05 13:56:04 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:56:04 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:56:04 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:56:04 user nova-compute[75233]:   </os>
Dec 05 13:56:04 user nova-compute[75233]:   <features>
Dec 05 13:56:04 user nova-compute[75233]:     <acpi/>
Dec 05 13:56:04 user nova-compute[75233]:     <apic/>
Dec 05 13:56:04 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:56:04 user nova-compute[75233]:   </features>
Dec 05 13:56:04 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:56:04 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:56:04 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:56:04 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:56:04 user nova-compute[75233]:   </clock>
Dec 05 13:56:04 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:56:04 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:56:04 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:56:04 user nova-compute[75233]:   </cpu>
Dec 05 13:56:04 user nova-compute[75233]:   <devices>
Dec 05 13:56:04 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:56:04 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:04 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 13:56:04 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:56:04 user nova-compute[75233]:       <serial>9e8c7f28-31bb-4a30-91a5-36157799bcf4</serial>
Dec 05 13:56:04 user nova-compute[75233]:     </disk>
Dec 05 13:56:04 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:56:04 user nova-compute[75233]:       <mac address="fa:16:3e:71:49:1a"/>
Dec 05 13:56:04 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:56:04 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:56:04 user nova-compute[75233]:       <target dev="tap021bf74e-59"/>
Dec 05 13:56:04 user nova-compute[75233]:     </interface>
Dec 05 13:56:04 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:56:04 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/11fe694c-476e-465f-8b23-f8e2bffd7938/console.log" append="off"/>
Dec 05 13:56:04 user nova-compute[75233]:     </serial>
Dec 05 13:56:04 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:56:04 user nova-compute[75233]:     <video>
Dec 05 13:56:04 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:56:04 user nova-compute[75233]:     </video>
Dec 05 13:56:04 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:56:04 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:56:04 user nova-compute[75233]:     </rng>
Dec 05 13:56:04 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:56:04 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:56:04 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:56:04 user nova-compute[75233]:     </memballoon>
Dec 05 13:56:04 user nova-compute[75233]:   </devices>
Dec 05 13:56:04 user nova-compute[75233]: </domain>
Dec 05 13:56:04 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911532962',display_name='tempest-ServerActionsTestOtherA-server-911532962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911532962',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-l7i7d47w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=11fe694c-476e-465f-8b23-f8e2bffd7938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG os_vif [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e210984-811a-52cc-8747-3fbedbda3a3e', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap021bf74e-59, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap021bf74e-59, col_values=(('qos', UUID('1dc12eec-3bb0-4d93-b532-2f18d8d836f5')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap021bf74e-59, col_values=(('external_ids', {'iface-id': '021bf74e-59c6-4e5b-92f0-5c75b594384e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:49:1a', 'vm-uuid': '11fe694c-476e-465f-8b23-f8e2bffd7938'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:04 user nova-compute[75233]: INFO os_vif [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59')
Dec 05 13:56:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:56:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No VIF found with MAC fa:16:3e:71:49:1a, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Skipping network cache update for instance because it is Building. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid bda94a77-e19a-4ea0-88ca-19c86689cd0b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-47e8a73c-7f84-436e-b714-b597702e3cb8 req-0230cf4c-12b6-40ad-80d2-b92ba863df41 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47e8a73c-7f84-436e-b714-b597702e3cb8 req-0230cf4c-12b6-40ad-80d2-b92ba863df41 service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47e8a73c-7f84-436e-b714-b597702e3cb8 req-0230cf4c-12b6-40ad-80d2-b92ba863df41 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-47e8a73c-7f84-436e-b714-b597702e3cb8 req-0230cf4c-12b6-40ad-80d2-b92ba863df41 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-47e8a73c-7f84-436e-b714-b597702e3cb8 req-0230cf4c-12b6-40ad-80d2-b92ba863df41 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:05 user nova-compute[75233]: WARNING nova.compute.manager [req-47e8a73c-7f84-436e-b714-b597702e3cb8 req-0230cf4c-12b6-40ad-80d2-b92ba863df41 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state building and task_state spawning.
Dec 05 13:56:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJCNuMVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:56:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:06 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:56:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d2974-e87b-42cf-82f3-53c3702ebde3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:56:07 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a280d9-19b0-41db-ac99-d77b81ef860e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26] added
Dec 05 13:56:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f26a047-26a0-4b1a-8804-964066efc098]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c5e96d-eca7-4c69-bc34-a3e318f1586b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJCNuMVR {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJCNuMVR" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9d9409-be58-4b2c-ad3e-198ab4919e83]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJCNuMVR'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1442f14b-2627-4daa-9fe9-5c23db881b4b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[86362a17-2dd7-459e-b83a-6f55c45d6d3e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[807da593-72bc-4f0e-9dae-53f079a4f527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260]
Dec 05 13:56:07 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260] successful.
Dec 05 13:56:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[671fc316-ad2e-421a-aad8-20c8e90cc285]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a7dc23-d3cb-473a-b268-ef70cc8384cc]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59dbe2-0cf3-4b84-99a6-5148088e15f3]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJCNuMVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:56:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance spawned successfully.
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-6235a91f-0811-458c-8ef4-8b9051c1883b req-ca8b639a-cfa6-43fe-a2a7-3e5ee1c312bc service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6235a91f-0811-458c-8ef4-8b9051c1883b req-ca8b639a-cfa6-43fe-a2a7-3e5ee1c312bc service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6235a91f-0811-458c-8ef4-8b9051c1883b req-ca8b639a-cfa6-43fe-a2a7-3e5ee1c312bc service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6235a91f-0811-458c-8ef4-8b9051c1883b req-ca8b639a-cfa6-43fe-a2a7-3e5ee1c312bc service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-6235a91f-0811-458c-8ef4-8b9051c1883b req-ca8b639a-cfa6-43fe-a2a7-3e5ee1c312bc service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:07 user nova-compute[75233]: WARNING nova.compute.manager [req-6235a91f-0811-458c-8ef4-8b9051c1883b req-ca8b639a-cfa6-43fe-a2a7-3e5ee1c312bc service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state building and task_state spawning.
Dec 05 13:56:07 user nova-compute[75233]: INFO nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Took 5.34 seconds to spawn the instance on the hypervisor.
Dec 05 13:56:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:56:07 user nova-compute[75233]: INFO nova.compute.manager [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Took 16.50 seconds to build instance.
Dec 05 13:56:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-11cb4177-5feb-4224-8079-ca5303ef6b34 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.595s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23766643935343939', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766643935343939', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:56:08 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:08 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:56:08 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:56:08 user nova-compute[75233]:   <serial>a5cb4d7f-65b8-45a6-aa75-8aff61962e26</serial>
Dec 05 13:56:08 user nova-compute[75233]: </disk>
Dec 05 13:56:08 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:e0:96:8a, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:56:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0f1baa42-671b-43c4-9e12-d3c5efd85ce6 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.156s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:10 user nova-compute[75233]: INFO nova.compute.manager [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Detaching volume a5cb4d7f-65b8-45a6-aa75-8aff61962e26
Dec 05 13:56:10 user nova-compute[75233]: INFO nova.virt.block_device [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Attempting to driver detach volume a5cb4d7f-65b8-45a6-aa75-8aff61962e26 from mountpoint /dev/vdb
Dec 05 13:56:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Attempting to detach device vdb from instance eabd1057-003a-4b46-9fa1-1378b4f7388b from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:56:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:56:10 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:10 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:56:10 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:56:10 user nova-compute[75233]:   <serial>a5cb4d7f-65b8-45a6-aa75-8aff61962e26</serial>
Dec 05 13:56:10 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:56:10 user nova-compute[75233]: </disk>
Dec 05 13:56:10 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:56:10 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully detached device vdb from instance eabd1057-003a-4b46-9fa1-1378b4f7388b from the persistent domain config.
Dec 05 13:56:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eabd1057-003a-4b46-9fa1-1378b4f7388b from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:56:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:56:10 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:10 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:56:10 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:56:10 user nova-compute[75233]:   <serial>a5cb4d7f-65b8-45a6-aa75-8aff61962e26</serial>
Dec 05 13:56:10 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:56:10 user nova-compute[75233]: </disk>
Dec 05 13:56:10 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:56:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:10 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqZIbgnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:56:13 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:13 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:13 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe08fd5-b154-40e4-a834-26946f46e474]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:56:13 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13f505-b9ef-42be-abd8-b8cb754b2deb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6] added
Dec 05 13:56:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b95d1-3d06-4877-aaa5-87b3b6b74c31]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3029bbd3-9e47-4976-addb-04d9f7856aa4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqZIbgnd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqZIbgnd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5528f-25f5-40b5-bc82-da8c798a1fc1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqZIbgnd'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500d20c-b836-4861-b4ec-275b597082d3]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042c5bc-f52f-430e-b082-75b5c3a5f124]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df7b949-2fdd-4096-870b-15ec23979c53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260]
Dec 05 13:56:13 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260] successful.
Dec 05 13:56:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9fb1c-24c9-4e33-86e5-851a10a810c8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b153f7a-bb45-4b2b-b5a7-f65f14d3cc1c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)
Dec 05 13:56:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2434b-9c14-4d05-bbab-ca0fbdd0eb97]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:56:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqZIbgnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:56:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26531363435616439', 'path': '/dev/sdf'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:56:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531363435616439', 'path': '/dev/sdf'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:56:14 user nova-compute[75233]: DEBUG nova.objects.instance [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:56:14 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:14 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:56:14 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:56:14 user nova-compute[75233]:   <serial>30042a00-cf53-4972-9176-2718605f4da6</serial>
Dec 05 13:56:14 user nova-compute[75233]: </disk>
Dec 05 13:56:14 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:56:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:56:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:56:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No VIF found with MAC fa:16:3e:5b:80:e7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:56:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-27a88f9e-9330-4235-830c-2217a47bf39b tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.173s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:17 user nova-compute[75233]: INFO nova.compute.manager [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Detaching volume 30042a00-cf53-4972-9176-2718605f4da6
Dec 05 13:56:17 user nova-compute[75233]: INFO nova.virt.block_device [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attempting to driver detach volume 30042a00-cf53-4972-9176-2718605f4da6 from mountpoint /dev/vdb
Dec 05 13:56:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Attempting to detach device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:56:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:56:17 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:17 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:56:17 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:56:17 user nova-compute[75233]:   <serial>30042a00-cf53-4972-9176-2718605f4da6</serial>
Dec 05 13:56:17 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:56:17 user nova-compute[75233]: </disk>
Dec 05 13:56:17 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:56:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config.
Dec 05 13:56:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:56:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:56:17 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:56:17 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:56:17 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:56:17 user nova-compute[75233]:   <serial>30042a00-cf53-4972-9176-2718605f4da6</serial>
Dec 05 13:56:17 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:56:17 user nova-compute[75233]: </disk>
Dec 05 13:56:17 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:56:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:56:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:20 user nova-compute[75233]: INFO nova.compute.manager [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Unrescuing
Dec 05 13:56:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:56:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:56:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'flavor' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-0c5858b2-4884-4c44-b2a5-646e3f3698ad req-bae44c33-5472-4f2a-ad72-561535164f73 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0c5858b2-4884-4c44-b2a5-646e3f3698ad req-bae44c33-5472-4f2a-ad72-561535164f73 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0c5858b2-4884-4c44-b2a5-646e3f3698ad req-bae44c33-5472-4f2a-ad72-561535164f73 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0c5858b2-4884-4c44-b2a5-646e3f3698ad req-bae44c33-5472-4f2a-ad72-561535164f73 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-0c5858b2-4884-4c44-b2a5-646e3f3698ad req-bae44c33-5472-4f2a-ad72-561535164f73 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:21 user nova-compute[75233]: WARNING nova.compute.manager [req-0c5858b2-4884-4c44-b2a5-646e3f3698ad req-bae44c33-5472-4f2a-ad72-561535164f73 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:56:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance destroyed successfully.
Dec 05 13:56:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:23 user nova-compute[75233]: WARNING nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:56:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:23 user nova-compute[75233]: WARNING nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:56:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:23 user nova-compute[75233]: WARNING nova.compute.manager [req-eea946d0-fcaa-4675-a9c6-ca49a7436970 req-57766e91-ede9-48ac-ac06-3faa3cb3b398 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state rescued and task_state unrescuing.
Dec 05 13:56:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0788b066-89e6-4cb5-9157-baa4f5b10469 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:56:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eabd1057-003a-4b46-9fa1-1378b4f7388b is timed out.
Dec 05 13:56:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully detached device vdb from instance eabd1057-003a-4b46-9fa1-1378b4f7388b from the live domain config.
Dec 05 13:56:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJCNuMVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:56:30 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28abe85f-01e7-43c8-9ccd-11c9f5af4c95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:56:30 user nova-compute[75233]: No targets found.
Dec 05 13:56:30 user nova-compute[75233]: iSNS:
Dec 05 13:56:30 user nova-compute[75233]: No targets found.
Dec 05 13:56:30 user nova-compute[75233]: STATIC:
Dec 05 13:56:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:56:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6
Dec 05 13:56:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:56:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:56:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:30 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26
Dec 05 13:56:30 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:30 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:30 user nova-compute[75233]: FIRMWARE:
Dec 05 13:56:30 user nova-compute[75233]: No targets found.
Dec 05 13:56:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:56:30 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:56:30 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dc3761-2ae4-4d1c-b7e1-b4579623ed69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e87de3-92ed-48d3-92bd-a08af85cbda9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)
Dec 05 13:56:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f345032e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a6c8b-8915-4620-94d1-c311c9e141fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[916cf027-5bae-46e1-a6c7-2c21d07bb762]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cefac3-ca24-4c5f-b520-c59e5b0e3e1a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b0075-8254-4f3d-94d7-8c82a32f3986]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[925d5be7-119a-42d7-ae37-be986fdce989]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f7810-e5a4-4975-9208-f0ecf8bc4bd5]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260]
Dec 05 13:56:31 user nova-compute[75233]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26, portal: 172.16.0.220,3260] successful.
Dec 05 13:56:31 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5cb4d7f-65b8-45a6-aa75-8aff61962e26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ea1c3d-e2ab-4049-819f-2aaf6dd5a42c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== disconnect_volume: return (318ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-93e717a7-f1bf-4aa1-8236-3c4dcbde725d tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e is timed out.
Dec 05 13:56:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config.
Dec 05 13:56:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqZIbgnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:56:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[45291cae-aee4-4d1f-b408-c5c8fa0fe029]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:56:38 user nova-compute[75233]: No targets found.
Dec 05 13:56:38 user nova-compute[75233]: iSNS:
Dec 05 13:56:38 user nova-compute[75233]: No targets found.
Dec 05 13:56:38 user nova-compute[75233]: STATIC:
Dec 05 13:56:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:56:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6
Dec 05 13:56:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:56:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:38 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:56:38 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:56:38 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:56:38 user nova-compute[75233]: FIRMWARE:
Dec 05 13:56:38 user nova-compute[75233]: No targets found.
Dec 05 13:56:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:56:38 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:56:38 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[26799620-a1f0-4fac-81ba-d6aee5544021]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cf24d7-2e3f-40dc-b52b-3ad9affe5965]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:38 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:38 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:38 user nova-compute[75233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)
Dec 05 13:56:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:56:38 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:56:38 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:56:38 user nova-compute[75233]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 (non-flash)
Dec 05 13:56:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34502290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6'): ({'sdf'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Removing single pathed devices sdf {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1785e10e-17b5-496c-bd1f-3a45fb34d6af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[896f7d87-0c94-4336-91eb-892c9969df7c]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Flushing IO for device /dev/sdf {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d99adf6-5319-49c2-88c4-245659f48d24]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95504e62-be17-4e15-9868-e8db0f21ce5a]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea92a4a-8e0e-4b70-816e-0df26cd142eb]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afeecd2-72b0-49d3-9c19-1d23c8e48a10]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260]
Dec 05 13:56:38 user nova-compute[75233]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6, portal: 172.16.0.220,3260] successful.
Dec 05 13:56:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30042a00-cf53-4972-9176-2718605f4da6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842f399-5f5c-48ea-9367-29552ce64f52]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== disconnect_volume: return (294ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:56:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:56:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-eb5f28d7-469d-4525-b9ac-1c20732a4766 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:53 user nova-compute[75233]: INFO nova.compute.manager [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Terminating instance
Dec 05 13:56:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-7774c2ac-10f3-4847-94a8-52718c6e07e6 req-d2449d69-0683-499e-be81-0af83590b1ff service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-vif-unplugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7774c2ac-10f3-4847-94a8-52718c6e07e6 req-d2449d69-0683-499e-be81-0af83590b1ff service nova] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7774c2ac-10f3-4847-94a8-52718c6e07e6 req-d2449d69-0683-499e-be81-0af83590b1ff service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7774c2ac-10f3-4847-94a8-52718c6e07e6 req-d2449d69-0683-499e-be81-0af83590b1ff service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-7774c2ac-10f3-4847-94a8-52718c6e07e6 req-d2449d69-0683-499e-be81-0af83590b1ff service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] No waiting events found dispatching network-vif-unplugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-7774c2ac-10f3-4847-94a8-52718c6e07e6 req-d2449d69-0683-499e-be81-0af83590b1ff service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-vif-unplugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Instance destroyed successfully.
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lazy-loading 'resources' on Instance uuid 6acef074-442c-46e9-8d68-b8826ac7c2f4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1363989773',display_name='tempest-ServersNegativeTestJSON-server-1363989773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1363989773',id=32,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d6981d4b1664b71b00ba32fd7ff1425',ramdisk_id='',reservation_id='r-lzwr2a0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1092330110',owner_user_name='tempest-ServersNegativeTestJSON-1092330110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:55:10Z,user_data=None,user_id='6c61839790d6421c8ce129287e6dbc0b',uuid=6acef074-442c-46e9-8d68-b8826ac7c2f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converting VIF {"id": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "address": "fa:16:3e:8a:dd:cf", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d25588-8e", "ovs_interfaceid": "d3d25588-8e21-47aa-b90a-78fb04eb9e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG os_vif [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d25588-8e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e52de50b-bc3d-4d8a-98a6-75ca4989c430) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:56:54 user nova-compute[75233]: INFO os_vif [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:dd:cf,bridge_name='br-int',has_traffic_filtering=True,id=d3d25588-8e21-47aa-b90a-78fb04eb9e0e,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d25588-8e')
Dec 05 13:56:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Deleting instance files /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4_del
Dec 05 13:56:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Deletion of /opt/stack/data/nova/instances/6acef074-442c-46e9-8d68-b8826ac7c2f4_del complete
Dec 05 13:56:54 user nova-compute[75233]: INFO nova.compute.manager [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:56:54 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Took 0.57 seconds to deallocate network for instance.
Dec 05 13:56:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-28ebd495-7b31-4b87-879f-9a5e5ee0b57a req-e1dbce58-d8f0-4fdb-9d0c-d5479e470edb service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-vif-deleted-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:55 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Deleted allocations for instance 6acef074-442c-46e9-8d68-b8826ac7c2f4
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a4b799e5-3e45-45d3-84c4-fe134add14c8 tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-ec8dbf4b-d999-44c1-baa8-05b4045d8da4 req-c01e8308-cc75-48b5-a8d7-945788cb9096 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received event network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ec8dbf4b-d999-44c1-baa8-05b4045d8da4 req-c01e8308-cc75-48b5-a8d7-945788cb9096 service nova] Acquiring lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ec8dbf4b-d999-44c1-baa8-05b4045d8da4 req-c01e8308-cc75-48b5-a8d7-945788cb9096 service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ec8dbf4b-d999-44c1-baa8-05b4045d8da4 req-c01e8308-cc75-48b5-a8d7-945788cb9096 service nova] Lock "6acef074-442c-46e9-8d68-b8826ac7c2f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-ec8dbf4b-d999-44c1-baa8-05b4045d8da4 req-c01e8308-cc75-48b5-a8d7-945788cb9096 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] No waiting events found dispatching network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:56:56 user nova-compute[75233]: WARNING nova.compute.manager [req-ec8dbf4b-d999-44c1-baa8-05b4045d8da4 req-c01e8308-cc75-48b5-a8d7-945788cb9096 service nova] [instance: 6acef074-442c-46e9-8d68-b8826ac7c2f4] Received unexpected event network-vif-plugged-d3d25588-8e21-47aa-b90a-78fb04eb9e0e for instance with vm_state deleted and task_state None.
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:56:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:56:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:56:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.013408660888672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance eabd1057-003a-4b46-9fa1-1378b4f7388b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 965d565d-b95b-4374-b28e-4a8180f4a702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a83ef82d-ed7f-41e7-8666-f74b251c1ce2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:56:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:56:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:00 user nova-compute[75233]: INFO nova.compute.manager [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Terminating instance
Dec 05 13:57:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-284268a8-335f-44b5-a39c-2c00cfd12fbd req-c3ce733a-a2e2-4104-866c-0d07035da24b service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-vif-unplugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-284268a8-335f-44b5-a39c-2c00cfd12fbd req-c3ce733a-a2e2-4104-866c-0d07035da24b service nova] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-284268a8-335f-44b5-a39c-2c00cfd12fbd req-c3ce733a-a2e2-4104-866c-0d07035da24b service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-284268a8-335f-44b5-a39c-2c00cfd12fbd req-c3ce733a-a2e2-4104-866c-0d07035da24b service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-284268a8-335f-44b5-a39c-2c00cfd12fbd req-c3ce733a-a2e2-4104-866c-0d07035da24b service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] No waiting events found dispatching network-vif-unplugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-284268a8-335f-44b5-a39c-2c00cfd12fbd req-c3ce733a-a2e2-4104-866c-0d07035da24b service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-vif-unplugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:57:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Instance destroyed successfully.
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.objects.instance [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'resources' on Instance uuid eabd1057-003a-4b46-9fa1-1378b4f7388b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1320016890',display_name='tempest-AttachVolumeNegativeTest-server-1320016890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1320016890',id=31,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsZcycrOwDI8D9w7dTwolh2YeTqtA1WqembduFlKH5dbb8OIhD2yS2TnjFYONzHhq1+M0+Stp92VjAV73bjLAyjnguwYLqpdtwYq44nBumt8Tlu6hxIpmUWPziADcGo5g==',key_name='tempest-keypair-1059253530',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-wqikkllt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=eabd1057-003a-4b46-9fa1-1378b4f7388b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "address": "fa:16:3e:e0:96:8a", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e78e3e1-58", "ovs_interfaceid": "5e78e3e1-5892-426d-a2df-b51cb27fa899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG os_vif [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e78e3e1-58, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e2681b0-b303-432b-b08a-6351c4ec91bf) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:01 user nova-compute[75233]: INFO os_vif [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:96:8a,bridge_name='br-int',has_traffic_filtering=True,id=5e78e3e1-5892-426d-a2df-b51cb27fa899,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e78e3e1-58')
Dec 05 13:57:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Deleting instance files /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b_del
Dec 05 13:57:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Deletion of /opt/stack/data/nova/instances/eabd1057-003a-4b46-9fa1-1378b4f7388b_del complete
Dec 05 13:57:01 user nova-compute[75233]: INFO nova.compute.manager [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 05 13:57:01 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:57:01 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:57:02 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:02 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Took 0.90 seconds to deallocate network for instance.
Dec 05 13:57:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-5fa4b4f8-cec4-4e1e-b498-e1c35af9cb13 req-f139a1c6-ef3f-45d0-9015-3933d9fef7f5 service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-vif-deleted-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:02 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:57:02 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:57:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:03 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Deleted allocations for instance eabd1057-003a-4b46-9fa1-1378b4f7388b
Dec 05 13:57:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9ee7823a-10cb-4bdd-afc4-9542fedf0afa tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.290s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-f2f902d6-3664-4f46-b7bf-be01045ed0ac req-a6a7641c-54ae-4d44-8b79-8177d304a29e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received event network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f2f902d6-3664-4f46-b7bf-be01045ed0ac req-a6a7641c-54ae-4d44-8b79-8177d304a29e service nova] Acquiring lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f2f902d6-3664-4f46-b7bf-be01045ed0ac req-a6a7641c-54ae-4d44-8b79-8177d304a29e service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f2f902d6-3664-4f46-b7bf-be01045ed0ac req-a6a7641c-54ae-4d44-8b79-8177d304a29e service nova] Lock "eabd1057-003a-4b46-9fa1-1378b4f7388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-f2f902d6-3664-4f46-b7bf-be01045ed0ac req-a6a7641c-54ae-4d44-8b79-8177d304a29e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] No waiting events found dispatching network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:03 user nova-compute[75233]: WARNING nova.compute.manager [req-f2f902d6-3664-4f46-b7bf-be01045ed0ac req-a6a7641c-54ae-4d44-8b79-8177d304a29e service nova] [instance: eabd1057-003a-4b46-9fa1-1378b4f7388b] Received unexpected event network-vif-plugged-5e78e3e1-5892-426d-a2df-b51cb27fa899 for instance with vm_state deleted and task_state None.
Dec 05 13:57:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:57:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:57:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG nova.objects.instance [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:10 user nova-compute[75233]: INFO nova.compute.manager [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attaching volume 8b1790f0-33b5-4c52-932b-570dd3a17b5e to /dev/vdb
Dec 05 13:57:10 user nova-compute[75233]: DEBUG os_brick.utils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4776225e-997d-42da-b368-782211a7e968]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dccfd9f-73f8-4c30-83c9-d931e74fe4a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b963043-97a3-46e5-b689-c9e2149a07ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc873ae-aaaf-4db8-99ca-591f648d9432]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:11 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3551a4b-3a37-43af-a3cf-868767b7e220]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG os_brick.utils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating existing volume attachment record: f9118360-08b6-41a4-82c7-a63d055cc544 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-changed-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Refreshing instance network info cache due to event network-changed-6f867925-1c09-4a2a-9307-07c5a473ae74. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] Acquiring lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] Acquired lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:11 user nova-compute[75233]: DEBUG nova.network.neutron [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Refreshing network info cache for port 6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:57:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updated VIF entry in instance network info cache for port 6f867925-1c09-4a2a-9307-07c5a473ae74. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:57:12 user nova-compute[75233]: DEBUG nova.network.neutron [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updating instance_info_cache with network_info: [{"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b28c37d2-aa7b-4e9f-b9ac-5feee9ae8958 req-e310730f-5daa-4db6-ab3a-656235816266 service nova] Releasing lock "refresh_cache-965d565d-b95b-4374-b28e-4a8180f4a702" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "164badc4-149a-40ce-b2b1-8b2718826466" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:57:14 user nova-compute[75233]: INFO nova.compute.claims [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Claim successful on node user
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:57:14 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:57:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.policy [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4e481441e684d12bdda2cd1b17ccd72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68724e2b4d34134abad8a99fc3d562b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:57:15 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Creating image(s)
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "/opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "/opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "/opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk 1073741824" returned: 0 in 0.053s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Successfully created port: aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Cannot resize image /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Ensure instance console log exists: /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Successfully updated port: aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "refresh_cache-164badc4-149a-40ce-b2b1-8b2718826466" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquired lock "refresh_cache-164badc4-149a-40ce-b2b1-8b2718826466" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-changed-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Refreshing instance network info cache due to event network-changed-aeb38706-5f6e-43f3-be7f-4476e668841c. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] Acquiring lock "refresh_cache-164badc4-149a-40ce-b2b1-8b2718826466" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Updating instance_info_cache with network_info: [{"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Releasing lock "refresh_cache-164badc4-149a-40ce-b2b1-8b2718826466" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Instance network_info: |[{"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] Acquired lock "refresh_cache-164badc4-149a-40ce-b2b1-8b2718826466" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Refreshing network info cache for port aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Start _get_guest_xml network_info=[{"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:57:16 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:57:16 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-789235084',display_name='tempest-VolumesActionsTest-instance-789235084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-789235084',id=35,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d68724e2b4d34134abad8a99fc3d562b',ramdisk_id='',reservation_id='r-p6ea5s9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2088742372',owner_user_name='tempest-VolumesActionsTest-2088742372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:15Z,user_data=None,user_id='d4e481441e684d12bdda2cd1b17ccd72',uuid=164badc4-149a-40ce-b2b1-8b2718826466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Converting VIF {"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lazy-loading 'pci_devices' on Instance uuid 164badc4-149a-40ce-b2b1-8b2718826466 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:57:16 user nova-compute[75233]:   <uuid>164badc4-149a-40ce-b2b1-8b2718826466</uuid>
Dec 05 13:57:16 user nova-compute[75233]:   <name>instance-00000023</name>
Dec 05 13:57:16 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:57:16 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:57:16 user nova-compute[75233]:   <metadata>
Dec 05 13:57:16 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:57:16 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:57:16 user nova-compute[75233]:       <nova:name>tempest-VolumesActionsTest-instance-789235084</nova:name>
Dec 05 13:57:16 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:57:16</nova:creationTime>
Dec 05 13:57:16 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:57:16 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:57:16 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:57:16 user nova-compute[75233]:       <nova:owner>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:user uuid="d4e481441e684d12bdda2cd1b17ccd72">tempest-VolumesActionsTest-2088742372-project-member</nova:user>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:project uuid="d68724e2b4d34134abad8a99fc3d562b">tempest-VolumesActionsTest-2088742372</nova:project>
Dec 05 13:57:16 user nova-compute[75233]:       </nova:owner>
Dec 05 13:57:16 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:57:16 user nova-compute[75233]:       <nova:ports>
Dec 05 13:57:16 user nova-compute[75233]:         <nova:port uuid="aeb38706-5f6e-43f3-be7f-4476e668841c">
Dec 05 13:57:16 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 13:57:16 user nova-compute[75233]:         </nova:port>
Dec 05 13:57:16 user nova-compute[75233]:       </nova:ports>
Dec 05 13:57:16 user nova-compute[75233]:     </nova:instance>
Dec 05 13:57:16 user nova-compute[75233]:   </metadata>
Dec 05 13:57:16 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:57:16 user nova-compute[75233]:     <system>
Dec 05 13:57:16 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:57:16 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:57:16 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:57:16 user nova-compute[75233]:       <entry name="serial">164badc4-149a-40ce-b2b1-8b2718826466</entry>
Dec 05 13:57:16 user nova-compute[75233]:       <entry name="uuid">164badc4-149a-40ce-b2b1-8b2718826466</entry>
Dec 05 13:57:16 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:57:16 user nova-compute[75233]:     </system>
Dec 05 13:57:16 user nova-compute[75233]:   </sysinfo>
Dec 05 13:57:16 user nova-compute[75233]:   <os>
Dec 05 13:57:16 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:57:16 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:57:16 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:57:16 user nova-compute[75233]:   </os>
Dec 05 13:57:16 user nova-compute[75233]:   <features>
Dec 05 13:57:16 user nova-compute[75233]:     <acpi/>
Dec 05 13:57:16 user nova-compute[75233]:     <apic/>
Dec 05 13:57:16 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:57:16 user nova-compute[75233]:   </features>
Dec 05 13:57:16 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:57:16 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:57:16 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:57:16 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:57:16 user nova-compute[75233]:   </clock>
Dec 05 13:57:16 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:57:16 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:57:16 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:57:16 user nova-compute[75233]:   </cpu>
Dec 05 13:57:16 user nova-compute[75233]:   <devices>
Dec 05 13:57:16 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:57:16 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:57:16 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk"/>
Dec 05 13:57:16 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:57:16 user nova-compute[75233]:     </disk>
Dec 05 13:57:16 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:57:16 user nova-compute[75233]:       <mac address="fa:16:3e:f4:75:e9"/>
Dec 05 13:57:16 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:57:16 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:57:16 user nova-compute[75233]:       <target dev="tapaeb38706-5f"/>
Dec 05 13:57:16 user nova-compute[75233]:     </interface>
Dec 05 13:57:16 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:57:16 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/console.log" append="off"/>
Dec 05 13:57:16 user nova-compute[75233]:     </serial>
Dec 05 13:57:16 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:57:16 user nova-compute[75233]:     <video>
Dec 05 13:57:16 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:57:16 user nova-compute[75233]:     </video>
Dec 05 13:57:16 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:57:16 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:57:16 user nova-compute[75233]:     </rng>
Dec 05 13:57:16 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:57:16 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:57:16 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:57:16 user nova-compute[75233]:     </memballoon>
Dec 05 13:57:16 user nova-compute[75233]:   </devices>
Dec 05 13:57:16 user nova-compute[75233]: </domain>
Dec 05 13:57:16 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-789235084',display_name='tempest-VolumesActionsTest-instance-789235084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-789235084',id=35,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d68724e2b4d34134abad8a99fc3d562b',ramdisk_id='',reservation_id='r-p6ea5s9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2088742372',owner_user_name='tempest-VolumesActionsTest-2088742372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:15Z,user_data=None,user_id='d4e481441e684d12bdda2cd1b17ccd72',uuid=164badc4-149a-40ce-b2b1-8b2718826466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Converting VIF {"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG os_vif [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee6ad15e-be4f-5502-9dab-93a41db8460d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeb38706-5f, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaeb38706-5f, col_values=(('qos', UUID('bd979553-a0f6-445f-819d-6ceeda96d3bb')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaeb38706-5f, col_values=(('external_ids', {'iface-id': 'aeb38706-5f6e-43f3-be7f-4476e668841c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:75:e9', 'vm-uuid': '164badc4-149a-40ce-b2b1-8b2718826466'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:16 user nova-compute[75233]: INFO os_vif [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f')
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] No VIF found with MAC fa:16:3e:f4:75:e9, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:16 user nova-compute[75233]: INFO nova.compute.manager [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attaching volume b4a53142-6b10-45b6-9057-5db0d2d1138f to /dev/vdb
Dec 05 13:57:17 user nova-compute[75233]: DEBUG os_brick.utils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a437e-1234-4c09-a013-83fcdfbe43e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8f8af-0d58-4c18-9e01-b51cbc0b24f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02db7485-f154-4f63-8a78-10b4d2253677]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c3a812-c04a-4303-b68a-f74afa663759]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Updated VIF entry in instance network info cache for port aeb38706-5f6e-43f3-be7f-4476e668841c. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Updating instance_info_cache with network_info: [{"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ad15aaae-bcb7-4c4a-9c54-01db44e4ae3f req-ca6e5f38-cf91-4d5c-8328-8945a11c9f38 service nova] Releasing lock "refresh_cache-164badc4-149a-40ce-b2b1-8b2718826466" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:17 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:57:17 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2721d6-f040-4dc6-a54d-250ed72c9170]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG os_brick.utils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:17 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updating existing volume attachment record: ab0aaa6b-468c-4333-9d20-ad970dac71cb {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-e0e8b8d4-e3d7-4acd-a154-ac9cb3fa721d req-58da824b-197a-413e-97b0-93ec2095a38e service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e0e8b8d4-e3d7-4acd-a154-ac9cb3fa721d req-58da824b-197a-413e-97b0-93ec2095a38e service nova] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e0e8b8d4-e3d7-4acd-a154-ac9cb3fa721d req-58da824b-197a-413e-97b0-93ec2095a38e service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e0e8b8d4-e3d7-4acd-a154-ac9cb3fa721d req-58da824b-197a-413e-97b0-93ec2095a38e service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-e0e8b8d4-e3d7-4acd-a154-ac9cb3fa721d req-58da824b-197a-413e-97b0-93ec2095a38e service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] No waiting events found dispatching network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:18 user nova-compute[75233]: WARNING nova.compute.manager [req-e0e8b8d4-e3d7-4acd-a154-ac9cb3fa721d req-58da824b-197a-413e-97b0-93ec2095a38e service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received unexpected event network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c for instance with vm_state building and task_state spawning.
Dec 05 13:57:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:57:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Instance spawned successfully.
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:20 user nova-compute[75233]: INFO nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Took 5.37 seconds to spawn the instance on the hypervisor.
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-065afabb-115e-4d10-bdea-9c4a0a739bb8 req-02fc11c8-b81a-4718-9f9b-0c14861ba34f service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-065afabb-115e-4d10-bdea-9c4a0a739bb8 req-02fc11c8-b81a-4718-9f9b-0c14861ba34f service nova] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-065afabb-115e-4d10-bdea-9c4a0a739bb8 req-02fc11c8-b81a-4718-9f9b-0c14861ba34f service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-065afabb-115e-4d10-bdea-9c4a0a739bb8 req-02fc11c8-b81a-4718-9f9b-0c14861ba34f service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-065afabb-115e-4d10-bdea-9c4a0a739bb8 req-02fc11c8-b81a-4718-9f9b-0c14861ba34f service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] No waiting events found dispatching network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:20 user nova-compute[75233]: WARNING nova.compute.manager [req-065afabb-115e-4d10-bdea-9c4a0a739bb8 req-02fc11c8-b81a-4718-9f9b-0c14861ba34f service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received unexpected event network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c for instance with vm_state building and task_state spawning.
Dec 05 13:57:20 user nova-compute[75233]: INFO nova.compute.manager [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Took 6.19 seconds to build instance.
Dec 05 13:57:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c012998b-d42b-4278-b3c6-80992a2471a0 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "164badc4-149a-40ce-b2b1-8b2718826466" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.295s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG nova.compute.manager [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing instance network info cache due to event network-changed-49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] Acquiring lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] Acquired lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG nova.network.neutron [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Refreshing network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:31 user nova-compute[75233]: INFO nova.compute.manager [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Terminating instance
Dec 05 13:57:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eglQAyHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:32 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-e46c1c62-ea45-4630-bb8a-9773c51831aa req-214e6596-cc3b-4e82-87e7-11d901fa92f3 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-unplugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e46c1c62-ea45-4630-bb8a-9773c51831aa req-214e6596-cc3b-4e82-87e7-11d901fa92f3 service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e46c1c62-ea45-4630-bb8a-9773c51831aa req-214e6596-cc3b-4e82-87e7-11d901fa92f3 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e46c1c62-ea45-4630-bb8a-9773c51831aa req-214e6596-cc3b-4e82-87e7-11d901fa92f3 service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-e46c1c62-ea45-4630-bb8a-9773c51831aa req-214e6596-cc3b-4e82-87e7-11d901fa92f3 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-unplugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-e46c1c62-ea45-4630-bb8a-9773c51831aa req-214e6596-cc3b-4e82-87e7-11d901fa92f3 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-unplugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8535490c-9458-42b9-b8ac-809b15b8afe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:57:32 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbd33fd-b28c-4211-bbdc-f22a5f7d3614]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e] added
Dec 05 13:57:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c55244-7013-44a6-8806-0e6a852a800b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQsFtNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.network.neutron [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updated VIF entry in instance network info cache for port 49f84095-c600-4bd3-9e7f-12ef0ab68924. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.network.neutron [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [{"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d30dd4-bd3d-477d-bdd0-7fde46ae5748]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eglQAyHG {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e5251133-93a7-4569-98f3-76bbad77c073 req-302cf07c-5bd1-456c-ada4-c7d81cdb0de4 service nova] Releasing lock "refresh_cache-a83ef82d-ed7f-41e7-8666-f74b251c1ce2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eglQAyHG" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec91b4-90f1-4d7d-b0b2-4416e3396b7a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eglQAyHG'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c3b52-b52d-47ff-85ef-e2f0bb9fbe41]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab474f9-3c10-4a67-b7f4-6821279a9af5]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e5e6f-2ed4-4c6a-9262-26308b899905]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260]
Dec 05 13:57:32 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc44bf-86bc-412a-8ec8-013b8343df7f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd8ad5-4ec5-4a9b-a92f-aa537ff19298]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:32 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:32 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4823d4cf-79b0-4ed0-97b3-2ed5578b3c6e]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:57:32 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Instance destroyed successfully.
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lazy-loading 'resources' on Instance uuid a83ef82d-ed7f-41e7-8666-f74b251c1ce2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T13:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1960902112',display_name='tempest-TestShelveInstance-server-1960902112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1960902112',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiqD6WhrnXmiRW6UXmwMGeYCxWEp54KSCoF1cUNUNvzuH88P8LyQoj5K8VQfPp0m0PFLPj8SpCtTo4oSUAkNjOiWhIJy65Ab7WVh2gX6etDGo/XvaGYSBT0ZUKHs8jGwg==',key_name='tempest-TestShelveInstance-2054970852',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:55:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ab64efbb5940c4a62331f4fce76a62',ramdisk_id='',reservation_id='r-j50rbkmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1187931716',owner_user_name='tempest-TestShelveInstance-1187931716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:55:58Z,user_data=None,user_id='a35a118fda664fe5a60df4a41ea7dc05',uuid=a83ef82d-ed7f-41e7-8666-f74b251c1ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converting VIF {"id": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "address": "fa:16:3e:e2:e5:50", "network": {"id": "6cf2bbef-bf91-447c-b699-58b1d35c3d24", "bridge": "br-int", "label": "tempest-TestShelveInstance-1457070723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ab64efbb5940c4a62331f4fce76a62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f84095-c6", "ovs_interfaceid": "49f84095-c600-4bd3-9e7f-12ef0ab68924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_vif [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49f84095-c6, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=277a091a-28ad-4c85-857e-c64ec05317c0) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:32 user nova-compute[75233]: INFO os_vif [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=49f84095-c600-4bd3-9e7f-12ef0ab68924,network=Network(6cf2bbef-bf91-447c-b699-58b1d35c3d24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f84095-c6')
Dec 05 13:57:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFxAJXsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:32 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eglQAyHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23330643731303636', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330643731303636', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.246s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:33 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:33 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c61032f-e796-42c9-98df-3351c1d56934]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:57:33 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:57:33 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:33 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:57:33 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:57:33 user nova-compute[75233]:   <serial>8b1790f0-33b5-4c52-932b-570dd3a17b5e</serial>
Dec 05 13:57:33 user nova-compute[75233]: </disk>
Dec 05 13:57:33 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a36101-fb69-416d-bec5-cef32e1b4eb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f] added
Dec 05 13:57:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[212bb847-c2c4-40e1-a1ec-6181b264449f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142359a-c83b-4eac-b4f3-4d89588aab00]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxQsFtNa {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxQsFtNa" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518398f-f893-40f9-b9d9-883550c65c87]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxQsFtNa'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab0abe-200f-4dc7-9fa9-4ca3955dbbf5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06843afe-a8eb-4b00-9dd6-b72530520a71]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842d352-eac7-4892-afd2-0a2f7d3dc686]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260]
Dec 05 13:57:33 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d3890-1a82-4c84-b608-473f7702d6ca]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4395047-9de3-4f2e-aedb-4a154975d1ae]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:33 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:33 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566faa4-6939-4a82-83fe-34c09c517871]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQsFtNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No VIF found with MAC fa:16:3e:5b:80:e7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-32210086-806c-468e-8da1-4c3e261898f9 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.148s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG nova.compute.manager [req-f6adb7c8-7ea5-44a7-8346-e3b0ee5979dd req-f31ddaa5-3593-4555-972c-ec0a3e73937b service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f6adb7c8-7ea5-44a7-8346-e3b0ee5979dd req-f31ddaa5-3593-4555-972c-ec0a3e73937b service nova] Acquiring lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f6adb7c8-7ea5-44a7-8346-e3b0ee5979dd req-f31ddaa5-3593-4555-972c-ec0a3e73937b service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f6adb7c8-7ea5-44a7-8346-e3b0ee5979dd req-f31ddaa5-3593-4555-972c-ec0a3e73937b service nova] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG nova.compute.manager [req-f6adb7c8-7ea5-44a7-8346-e3b0ee5979dd req-f31ddaa5-3593-4555-972c-ec0a3e73937b service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] No waiting events found dispatching network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:34 user nova-compute[75233]: WARNING nova.compute.manager [req-f6adb7c8-7ea5-44a7-8346-e3b0ee5979dd req-f31ddaa5-3593-4555-972c-ec0a3e73937b service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received unexpected event network-vif-plugged-49f84095-c600-4bd3-9e7f-12ef0ab68924 for instance with vm_state active and task_state deleting.
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== connect_volume: return (2574ms) {'type': 'block', 'scsi_wwn': '26333613534643537', 'path': '/dev/sdf'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333613534643537', 'path': '/dev/sdf'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.271s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c88829-1126-470f-90da-8026b5b7836d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:57:34 user nova-compute[75233]: No targets found.
Dec 05 13:57:34 user nova-compute[75233]: iSNS:
Dec 05 13:57:34 user nova-compute[75233]: No targets found.
Dec 05 13:57:34 user nova-compute[75233]: STATIC:
Dec 05 13:57:34 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:57:34 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:34 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:34 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e
Dec 05 13:57:34 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:34 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:34 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f
Dec 05 13:57:34 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:34 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:34 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:57:34 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:34 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:34 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25
Dec 05 13:57:34 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:34 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:34 user nova-compute[75233]: FIRMWARE:
Dec 05 13:57:34 user nova-compute[75233]: No targets found.
Dec 05 13:57:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:57:34 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:57:34 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:57:34 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:34 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:57:34 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:57:34 user nova-compute[75233]:   <serial>b4a53142-6b10-45b6-9057-5db0d2d1138f</serial>
Dec 05 13:57:34 user nova-compute[75233]: </disk>
Dec 05 13:57:34 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172f9e2-d50d-42dc-b0e7-711b0d919461]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ae5946-66f9-479f-ab56-ce2e90076a48]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:34 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:34 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34553ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd70c63-a49b-414b-b039-92b891863fa6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[63408978-8057-45d5-919b-04758f8ad895]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af47887-1860-4000-9dc5-691054ae5da8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e975e0-7186-45db-bb66-8905e976882b]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf90c18-80ba-428e-aeb0-83be7f8bbc7c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7b1c52-9f86-42a4-a574-319b7c92936c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260]
Dec 05 13:57:35 user nova-compute[75233]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c688f24-405b-45d5-aaa3-25de31b3ce25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ad202-701e-4eef-b155-bb9edbd2b339]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] <== disconnect_volume: return (2578ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:57:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Deleting instance files /opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2_del
Dec 05 13:57:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Deletion of /opt/stack/data/nova/instances/a83ef82d-ed7f-41e7-8666-f74b251c1ce2_del complete
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No VIF found with MAC fa:16:3e:31:ef:04, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:57:35 user nova-compute[75233]: INFO nova.compute.manager [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Took 3.64 seconds to destroy the instance on the hypervisor.
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0c8faf6f-01d1-4c39-8c27-39c89bd9bdb9 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.500s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:35 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:35 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Took 0.49 seconds to deallocate network for instance.
Dec 05 13:57:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:36 user nova-compute[75233]: INFO nova.compute.manager [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Detaching volume 8b1790f0-33b5-4c52-932b-570dd3a17b5e
Dec 05 13:57:36 user nova-compute[75233]: INFO nova.virt.block_device [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attempting to driver detach volume 8b1790f0-33b5-4c52-932b-570dd3a17b5e from mountpoint /dev/vdb
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Attempting to detach device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:57:36 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:36 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:57:36 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:57:36 user nova-compute[75233]:   <serial>8b1790f0-33b5-4c52-932b-570dd3a17b5e</serial>
Dec 05 13:57:36 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:57:36 user nova-compute[75233]: </disk>
Dec 05 13:57:36 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-f05feef9-6d48-4666-bec3-7c133402885b req-812a9e81-8227-4ed0-abca-3b022a365ea6 service nova] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Received event network-vif-deleted-49f84095-c600-4bd3-9e7f-12ef0ab68924 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config.
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:57:36 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:36 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 13:57:36 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:57:36 user nova-compute[75233]:   <serial>8b1790f0-33b5-4c52-932b-570dd3a17b5e</serial>
Dec 05 13:57:36 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:57:36 user nova-compute[75233]: </disk>
Dec 05 13:57:36 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:57:36 user nova-compute[75233]: INFO nova.compute.manager [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Took 0.79 seconds to detach 1 volumes for instance.
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] [instance: a83ef82d-ed7f-41e7-8666-f74b251c1ce2] Deleting volume: 4c688f24-405b-45d5-aaa3-25de31b3ce25 {{(pid=75233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 13:57:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:57:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:37 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:57:37 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:57:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:37 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Deleted allocations for instance a83ef82d-ed7f-41e7-8666-f74b251c1ce2
Dec 05 13:57:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-19805c95-76b2-4447-99db-2859c085efcf tempest-TestShelveInstance-1187931716 tempest-TestShelveInstance-1187931716-project-member] Lock "a83ef82d-ed7f-41e7-8666-f74b251c1ce2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.933s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:39 user nova-compute[75233]: INFO nova.compute.manager [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attaching volume 89acc6f3-57c2-4929-856c-aa171db26ea1 to /dev/vdc
Dec 05 13:57:39 user nova-compute[75233]: DEBUG os_brick.utils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd072e3-5116-442b-a02a-57ff791c1a56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aea175-7d5e-497f-990d-c51a006fed39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0d770-5a5b-41e8-bfe9-87e4e9de5b7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab373cd-f621-4616-b01d-d1f07a9c74be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:39 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:57:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db3031-0d10-4682-a0ad-0920fc741dfd]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG os_brick.utils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:39 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updating existing volume attachment record: 28ee7272-6644-4f5f-9d30-eb3c9ce9fba7 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:57:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-changed-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Refreshing instance network info cache due to event network-changed-5d515d32-8096-4b30-b4f7-caee81103ded. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Refreshing network info cache for port 5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated VIF entry in instance network info cache for port 5d515d32-8096-4b30-b4f7-caee81103ded. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5df50348-cf67-4bf7-9c64-56ce68f89c0a req-71417689-17f5-4ad1-9c9a-583eff7f0784 service nova] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Stashing vm_state: active {{(pid=75233) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:57:44 user nova-compute[75233]: INFO nova.compute.claims [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Claim successful on node user
Dec 05 13:57:44 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating resource usage from migration 078b29c2-2d27-4953-9317-d8e4abacac9c
Dec 05 13:57:44 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.702s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:44 user nova-compute[75233]: INFO nova.compute.manager [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Migrating
Dec 05 13:57:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-changed-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Refreshing instance network info cache due to event network-changed-021bf74e-59c6-4e5b-92f0-5c75b594384e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] Acquiring lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] Acquired lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG nova.network.neutron [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Refreshing network info cache for port 021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:57:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.network.neutron [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updated VIF entry in instance network info cache for port 021bf74e-59c6-4e5b-92f0-5c75b594384e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.network.neutron [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e1464c48-4f24-46b0-a34e-c3b1d66d9b23 req-ac05dbd3-12bf-4f1f-aac4-93ae17302d82 service nova] Releasing lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquired lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Releasing lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Starting migrate_disk_and_power_off {{(pid=75233) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-5b96b1ae-76e3-4df0-8aaa-7df6df202179 req-52dcb2fc-4254-4e2a-a1e4-c045aaeac58c service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5b96b1ae-76e3-4df0-8aaa-7df6df202179 req-52dcb2fc-4254-4e2a-a1e4-c045aaeac58c service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5b96b1ae-76e3-4df0-8aaa-7df6df202179 req-52dcb2fc-4254-4e2a-a1e4-c045aaeac58c service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5b96b1ae-76e3-4df0-8aaa-7df6df202179 req-52dcb2fc-4254-4e2a-a1e4-c045aaeac58c service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-5b96b1ae-76e3-4df0-8aaa-7df6df202179 req-52dcb2fc-4254-4e2a-a1e4-c045aaeac58c service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:45 user nova-compute[75233]: WARNING nova.compute.manager [req-5b96b1ae-76e3-4df0-8aaa-7df6df202179 req-52dcb2fc-4254-4e2a-a1e4-c045aaeac58c service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state resize_migrating.
Dec 05 13:57:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance destroyed successfully.
Dec 05 13:57:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911532962',display_name='tempest-ServerActionsTestOtherA-server-911532962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911532962',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-l7i7d47w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=11fe694c-476e-465f-8b23-f8e2bffd7938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap021bf74e-59, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dc12eec-3bb0-4d93-b532-2f18d8d836f5) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:46 user nova-compute[75233]: INFO os_vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59')
Dec 05 13:57:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:46 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbbc597-9a40-40fe-915a-03e1a38bf71e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:57:46 user nova-compute[75233]: No targets found.
Dec 05 13:57:46 user nova-compute[75233]: iSNS:
Dec 05 13:57:46 user nova-compute[75233]: No targets found.
Dec 05 13:57:46 user nova-compute[75233]: STATIC:
Dec 05 13:57:46 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:57:46 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:46 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:46 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e
Dec 05 13:57:46 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:46 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:46 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f
Dec 05 13:57:46 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:46 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:46 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:57:46 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:46 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:46 user nova-compute[75233]: FIRMWARE:
Dec 05 13:57:46 user nova-compute[75233]: No targets found.
Dec 05 13:57:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:57:46 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:57:46 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6a6eb-b980-4462-b633-f9ca74923f7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e5289-3c19-4c8a-92f1-4857c97de346]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:46 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:46 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:46 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:46 user nova-compute[75233]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:46 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:46 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f3479ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[710cb8fc-5794-407f-b73d-c81f7838f156]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c228053-fefe-482a-89b4-f8a4c91e56a2]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[264b6733-9833-4631-b9dc-d69dc203727d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d7e2b-b512-47ba-9a27-989c29def7d5]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[402330f0-0c0d-45b0-9e01-a950bd0c7056]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a190d1-4644-4d24-b30b-f3cd30f94163]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]
Dec 05 13:57:46 user nova-compute[75233]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa46e8-557d-4be1-bbc1-e7feed02b8fc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== disconnect_volume: return (369ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:57:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:57:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-4ce69581-1b96-4e0b-8182-e89aa4dc0e57 req-324027ba-1bcc-41e1-88b2-e5abe9622c68 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4ce69581-1b96-4e0b-8182-e89aa4dc0e57 req-324027ba-1bcc-41e1-88b2-e5abe9622c68 service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4ce69581-1b96-4e0b-8182-e89aa4dc0e57 req-324027ba-1bcc-41e1-88b2-e5abe9622c68 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4ce69581-1b96-4e0b-8182-e89aa4dc0e57 req-324027ba-1bcc-41e1-88b2-e5abe9622c68 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-4ce69581-1b96-4e0b-8182-e89aa4dc0e57 req-324027ba-1bcc-41e1-88b2-e5abe9622c68 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:47 user nova-compute[75233]: WARNING nova.compute.manager [req-4ce69581-1b96-4e0b-8182-e89aa4dc0e57 req-324027ba-1bcc-41e1-88b2-e5abe9622c68 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state resize_migrating.
Dec 05 13:57:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Port 021bf74e-59c6-4e5b-92f0-5c75b594384e binding to destination host user is already ACTIVE {{(pid=75233) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquired lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Releasing lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG os_brick.utils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0503123-c0b6-43f1-a033-4bcb568345f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f95eee-e520-4af2-9afd-993d6d313ada]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5b8e3b-53b8-494d-ba47-014330bcc8a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b40fa-bec8-4b92-ab43-4c797c47adab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:57:48 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:57:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2f66b-3296-4cc0-ac9d-79d1b7eb0476]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:57:48 user nova-compute[75233]: DEBUG os_brick.utils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muMbQDyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:49 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f702b2f-842b-449a-ad7a-ea52fa1ec62b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:57:49 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b098417c-ce51-490a-8c03-a4464ddde66e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1] added
Dec 05 13:57:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ec75e6-bf3c-4edc-be4d-76baf2428b0f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b84243-bc31-4a4d-8d4b-6f81e5845391]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muMbQDyw {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muMbQDyw" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97deeb70-9801-4568-87cd-9243cafbfb64]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muMbQDyw'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5238601a-f24d-4e53-a171-57972441a248]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d358ce-fccd-4c5b-8581-022c9596823e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15191db1-cd3c-448a-adcb-c23bdc5a3318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260]
Dec 05 13:57:49 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e730e-af3e-487f-a053-3b472e4a5694]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6722bcc3-603e-48ea-acfc-892c42af9c81]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:49 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b687f23-2a88-4e55-8d28-4820c14e6b7a]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:57:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muMbQDyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23463303261646338', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463303261646338', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:57:50 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:50 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:57:50 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 13:57:50 user nova-compute[75233]:   <serial>89acc6f3-57c2-4929-856c-aa171db26ea1</serial>
Dec 05 13:57:50 user nova-compute[75233]: </disk>
Dec 05 13:57:50 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] No VIF found with MAC fa:16:3e:31:ef:04, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:57:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8ef66506-9c17-432b-b7ba-366ec094a7db tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.033s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:52 user nova-compute[75233]: INFO nova.compute.manager [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Detaching volume b4a53142-6b10-45b6-9057-5db0d2d1138f
Dec 05 13:57:52 user nova-compute[75233]: INFO nova.virt.block_device [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attempting to driver detach volume b4a53142-6b10-45b6-9057-5db0d2d1138f from mountpoint /dev/vdb
Dec 05 13:57:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Attempting to detach device vdb from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:57:52 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:52 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:57:52 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:57:52 user nova-compute[75233]:   <serial>b4a53142-6b10-45b6-9057-5db0d2d1138f</serial>
Dec 05 13:57:52 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:57:52 user nova-compute[75233]: </disk>
Dec 05 13:57:52 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:57:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully detached device vdb from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the persistent domain config.
Dec 05 13:57:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:57:52 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:57:52 user nova-compute[75233]:   <source dev="/dev/sdf"/>
Dec 05 13:57:52 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:57:52 user nova-compute[75233]:   <serial>b4a53142-6b10-45b6-9057-5db0d2d1138f</serial>
Dec 05 13:57:52 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:57:52 user nova-compute[75233]: </disk>
Dec 05 13:57:52 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:57:54 user nova-compute[75233]: INFO nova.compute.claims [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Claim successful on node user
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:57:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.policy [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebeefb2fa465406b911b62137057223a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73a22149826499ba7d03f47ce7375cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:57:54 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Creating image(s)
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "/opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "/opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:54 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk 1073741824" returned: 0 in 0.046s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Successfully created port: 6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Cannot resize image /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Ensure instance console log exists: /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Successfully updated port: 6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquired lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-changed-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Refreshing instance network info cache due to event network-changed-6cf187fe-1d84-43d1-95ec-d07db6ca0b77. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] Acquiring lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updating instance_info_cache with network_info: [{"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Releasing lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Instance network_info: |[{"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] Acquired lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Refreshing network info cache for port 6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Start _get_guest_xml network_info=[{"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:57:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:57:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687533200',display_name='tempest-AttachVolumeNegativeTest-server-687533200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687533200',id=36,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMv3aisDFowgPlPq9kc9tUf7Fd2ak67uzKLrGpfC4SUY6GyBrDffsptEFzEoj1SOXpgz8xl9FzKZk4jvBXYsRfHmrYC0QbJ+nmuJ+/ZR2G50Vx37opLV7L9i+wH1uGDOw==',key_name='tempest-keypair-1000860518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-qle7ijut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=64b8a85a-9a06-4f5d-ace7-0d0b331c0768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.objects.instance [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:57:56 user nova-compute[75233]:   <uuid>64b8a85a-9a06-4f5d-ace7-0d0b331c0768</uuid>
Dec 05 13:57:56 user nova-compute[75233]:   <name>instance-00000024</name>
Dec 05 13:57:56 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:57:56 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:57:56 user nova-compute[75233]:   <metadata>
Dec 05 13:57:56 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:57:56 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:57:56 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeNegativeTest-server-687533200</nova:name>
Dec 05 13:57:56 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:57:56</nova:creationTime>
Dec 05 13:57:56 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:57:56 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:57:56 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:57:56 user nova-compute[75233]:       <nova:owner>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:user uuid="ebeefb2fa465406b911b62137057223a">tempest-AttachVolumeNegativeTest-525245035-project-member</nova:user>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:project uuid="f73a22149826499ba7d03f47ce7375cd">tempest-AttachVolumeNegativeTest-525245035</nova:project>
Dec 05 13:57:56 user nova-compute[75233]:       </nova:owner>
Dec 05 13:57:56 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:57:56 user nova-compute[75233]:       <nova:ports>
Dec 05 13:57:56 user nova-compute[75233]:         <nova:port uuid="6cf187fe-1d84-43d1-95ec-d07db6ca0b77">
Dec 05 13:57:56 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 13:57:56 user nova-compute[75233]:         </nova:port>
Dec 05 13:57:56 user nova-compute[75233]:       </nova:ports>
Dec 05 13:57:56 user nova-compute[75233]:     </nova:instance>
Dec 05 13:57:56 user nova-compute[75233]:   </metadata>
Dec 05 13:57:56 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:57:56 user nova-compute[75233]:     <system>
Dec 05 13:57:56 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:57:56 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:57:56 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:57:56 user nova-compute[75233]:       <entry name="serial">64b8a85a-9a06-4f5d-ace7-0d0b331c0768</entry>
Dec 05 13:57:56 user nova-compute[75233]:       <entry name="uuid">64b8a85a-9a06-4f5d-ace7-0d0b331c0768</entry>
Dec 05 13:57:56 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:57:56 user nova-compute[75233]:     </system>
Dec 05 13:57:56 user nova-compute[75233]:   </sysinfo>
Dec 05 13:57:56 user nova-compute[75233]:   <os>
Dec 05 13:57:56 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:57:56 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:57:56 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:57:56 user nova-compute[75233]:   </os>
Dec 05 13:57:56 user nova-compute[75233]:   <features>
Dec 05 13:57:56 user nova-compute[75233]:     <acpi/>
Dec 05 13:57:56 user nova-compute[75233]:     <apic/>
Dec 05 13:57:56 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:57:56 user nova-compute[75233]:   </features>
Dec 05 13:57:56 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:57:56 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:57:56 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:57:56 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:57:56 user nova-compute[75233]:   </clock>
Dec 05 13:57:56 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:57:56 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:57:56 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:57:56 user nova-compute[75233]:   </cpu>
Dec 05 13:57:56 user nova-compute[75233]:   <devices>
Dec 05 13:57:56 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:57:56 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:57:56 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk"/>
Dec 05 13:57:56 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:57:56 user nova-compute[75233]:     </disk>
Dec 05 13:57:56 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:57:56 user nova-compute[75233]:       <mac address="fa:16:3e:6c:03:e3"/>
Dec 05 13:57:56 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:57:56 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:57:56 user nova-compute[75233]:       <target dev="tap6cf187fe-1d"/>
Dec 05 13:57:56 user nova-compute[75233]:     </interface>
Dec 05 13:57:56 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:57:56 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/console.log" append="off"/>
Dec 05 13:57:56 user nova-compute[75233]:     </serial>
Dec 05 13:57:56 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:57:56 user nova-compute[75233]:     <video>
Dec 05 13:57:56 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:57:56 user nova-compute[75233]:     </video>
Dec 05 13:57:56 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:57:56 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:57:56 user nova-compute[75233]:     </rng>
Dec 05 13:57:56 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:57:56 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:57:56 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:57:56 user nova-compute[75233]:     </memballoon>
Dec 05 13:57:56 user nova-compute[75233]:   </devices>
Dec 05 13:57:56 user nova-compute[75233]: </domain>
Dec 05 13:57:56 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687533200',display_name='tempest-AttachVolumeNegativeTest-server-687533200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687533200',id=36,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMv3aisDFowgPlPq9kc9tUf7Fd2ak67uzKLrGpfC4SUY6GyBrDffsptEFzEoj1SOXpgz8xl9FzKZk4jvBXYsRfHmrYC0QbJ+nmuJ+/ZR2G50Vx37opLV7L9i+wH1uGDOw==',key_name='tempest-keypair-1000860518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-qle7ijut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=64b8a85a-9a06-4f5d-ace7-0d0b331c0768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_vif [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61fe3fca-2d87-59b9-ad36-ce4c58a3cb43', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cf187fe-1d, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cf187fe-1d, col_values=(('qos', UUID('9644411d-c7cd-4674-a33a-66f3473dba26')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cf187fe-1d, col_values=(('external_ids', {'iface-id': '6cf187fe-1d84-43d1-95ec-d07db6ca0b77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:03:e3', 'vm-uuid': '64b8a85a-9a06-4f5d-ace7-0d0b331c0768'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:56 user nova-compute[75233]: INFO os_vif [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d')
Dec 05 13:57:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e is timed out.
Dec 05 13:57:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config.
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eglQAyHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:56 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:6c:03:e3, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ec3d4-273e-4f77-b8e6-07852852682e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:57:56 user nova-compute[75233]: No targets found.
Dec 05 13:57:56 user nova-compute[75233]: iSNS:
Dec 05 13:57:56 user nova-compute[75233]: No targets found.
Dec 05 13:57:56 user nova-compute[75233]: STATIC:
Dec 05 13:57:56 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:57:56 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:56 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:56 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e
Dec 05 13:57:56 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:56 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:56 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1
Dec 05 13:57:56 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:56 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:56 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f
Dec 05 13:57:56 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:57:56 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:57:56 user nova-compute[75233]: FIRMWARE:
Dec 05 13:57:56 user nova-compute[75233]: No targets found.
Dec 05 13:57:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:57:56 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:57:56 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7304af35-9ee1-4e13-8f1f-1a16795be01a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da7394-3c90-4a3a-80d7-a8a7f4e568d3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:56 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:56 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:56 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:56 user nova-compute[75233]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e (non-flash)
Dec 05 13:57:56 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:56 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582c2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa73c40-02a8-4f21-996f-74af03c6ae09]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a30542-bcae-40ce-8d3d-2fe7676e26ab]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[24871632-bdd2-431d-896d-d706bfc7595e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updated VIF entry in instance network info cache for port 6cf187fe-1d84-43d1-95ec-d07db6ca0b77. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG nova.network.neutron [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updating instance_info_cache with network_info: [{"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a81ce270-f432-4ff1-941b-75ce64bbff62 req-9969b488-5719-4e83-b991-00f7b1660867 service nova] Releasing lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e455709e-a403-4d18-9ca0-f7fb360d5df8]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb0eb9a-0aa1-4e38-9460-b70db62269e9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e1f63-f8c3-4742-a4d0-b654f14d87a5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260]
Dec 05 13:57:57 user nova-compute[75233]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b1790f0-33b5-4c52-932b-570dd3a17b5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85289cd4-e26e-498e-af4f-ec7a3e43693e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== disconnect_volume: return (379ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-46c722d5-5299-4aa1-8532-a173a5aca2a4 req-bba9a4e6-206c-4315-94b0-164053360540 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-46c722d5-5299-4aa1-8532-a173a5aca2a4 req-bba9a4e6-206c-4315-94b0-164053360540 service nova] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-46c722d5-5299-4aa1-8532-a173a5aca2a4 req-bba9a4e6-206c-4315-94b0-164053360540 service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-46c722d5-5299-4aa1-8532-a173a5aca2a4 req-bba9a4e6-206c-4315-94b0-164053360540 service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-46c722d5-5299-4aa1-8532-a173a5aca2a4 req-bba9a4e6-206c-4315-94b0-164053360540 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] No waiting events found dispatching network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:57:58 user nova-compute[75233]: WARNING nova.compute.manager [req-46c722d5-5299-4aa1-8532-a173a5aca2a4 req-bba9a4e6-206c-4315-94b0-164053360540 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received unexpected event network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 for instance with vm_state building and task_state spawning.
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d5cf2b99-c02a-4ce5-b285-df0abce6c540 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.088s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Starting finish_migration {{(pid=75233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 13:57:58 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Creating image(s)
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Ensure instance console log exists: /opt/stack/data/nova/instances/11fe694c-476e-465f-8b23-f8e2bffd7938/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Start _get_guest_xml network_info=[{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11fe694c-476e-465f-8b23-f8e2bffd7938', 'attached_at': '2023-12-05T13:57:58.000000', 'detached_at': '', 'volume_id': '9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'serial': '9e8c7f28-31bb-4a30-91a5-36157799bcf4'}, 'delete_on_termination': True, 'attachment_id': 'a2af03d8-3967-4682-ba65-8b958e00395f', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:57:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:57:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:57:58 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:58 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:57:58 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:57:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4b9335-8d01-42ee-a649-00972ca26a54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:57:58 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a041312-3533-49cc-a050-553056d46499]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4] added
Dec 05 13:57:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[df55d581-f7e4-4f97-88b5-b26af8d62eb6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53912c9-cc23-41c2-84f5-1abbba10ad26]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ampsTHiq {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ampsTHiq" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d9d02d-537b-4386-a24c-e78828080703]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ampsTHiq'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de6cf6f-05bb-457a-8229-1a03d09839ff]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e69c1b2-37c0-4916-8fbc-3130f3e76710]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e974ec-aa2f-4565-a141-99c1ff00c481]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]
Dec 05 13:57:58 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.
Dec 05 13:57:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18ac12a-9ab8-4da6-96b6-6b35b7551870]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9f825-04df-409f-87dc-b8f9daf501a9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:57:58 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:57:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:57:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c093ef-b563-43db-a363-2e9f26a60426]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:57:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:58:00 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Instance spawned successfully.
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26433663636636463', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433663636636463', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911532962',display_name='tempest-ServerActionsTestOtherA-server-911532962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911532962',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-l7i7d47w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=11fe694c-476e-465f-8b23-f8e2bffd7938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:58:00 user nova-compute[75233]:   <uuid>11fe694c-476e-465f-8b23-f8e2bffd7938</uuid>
Dec 05 13:58:00 user nova-compute[75233]:   <name>instance-00000022</name>
Dec 05 13:58:00 user nova-compute[75233]:   <memory>2097152</memory>
Dec 05 13:58:00 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:58:00 user nova-compute[75233]:   <metadata>
Dec 05 13:58:00 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:58:00 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:58:00 user nova-compute[75233]:       <nova:name>tempest-ServerActionsTestOtherA-server-911532962</nova:name>
Dec 05 13:58:00 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:57:58</nova:creationTime>
Dec 05 13:58:00 user nova-compute[75233]:       <nova:flavor name="m1.small">
Dec 05 13:58:00 user nova-compute[75233]:         <nova:memory>2048</nova:memory>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:disk>20</nova:disk>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:58:00 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:58:00 user nova-compute[75233]:       <nova:owner>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:user uuid="5414614ea59f4b26938bf55a492e5ddd">tempest-ServerActionsTestOtherA-875899137-project-member</nova:user>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:project uuid="405f4ac4b28d405fb6f71f29c6557517">tempest-ServerActionsTestOtherA-875899137</nova:project>
Dec 05 13:58:00 user nova-compute[75233]:       </nova:owner>
Dec 05 13:58:00 user nova-compute[75233]:       <nova:ports>
Dec 05 13:58:00 user nova-compute[75233]:         <nova:port uuid="021bf74e-59c6-4e5b-92f0-5c75b594384e">
Dec 05 13:58:00 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 13:58:00 user nova-compute[75233]:         </nova:port>
Dec 05 13:58:00 user nova-compute[75233]:       </nova:ports>
Dec 05 13:58:00 user nova-compute[75233]:     </nova:instance>
Dec 05 13:58:00 user nova-compute[75233]:   </metadata>
Dec 05 13:58:00 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:58:00 user nova-compute[75233]:     <system>
Dec 05 13:58:00 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:58:00 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:58:00 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:58:00 user nova-compute[75233]:       <entry name="serial">11fe694c-476e-465f-8b23-f8e2bffd7938</entry>
Dec 05 13:58:00 user nova-compute[75233]:       <entry name="uuid">11fe694c-476e-465f-8b23-f8e2bffd7938</entry>
Dec 05 13:58:00 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:58:00 user nova-compute[75233]:     </system>
Dec 05 13:58:00 user nova-compute[75233]:   </sysinfo>
Dec 05 13:58:00 user nova-compute[75233]:   <os>
Dec 05 13:58:00 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:58:00 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:58:00 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:58:00 user nova-compute[75233]:   </os>
Dec 05 13:58:00 user nova-compute[75233]:   <features>
Dec 05 13:58:00 user nova-compute[75233]:     <acpi/>
Dec 05 13:58:00 user nova-compute[75233]:     <apic/>
Dec 05 13:58:00 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:58:00 user nova-compute[75233]:   </features>
Dec 05 13:58:00 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:58:00 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:58:00 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:58:00 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:58:00 user nova-compute[75233]:   </clock>
Dec 05 13:58:00 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:58:00 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:58:00 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:58:00 user nova-compute[75233]:   </cpu>
Dec 05 13:58:00 user nova-compute[75233]:   <devices>
Dec 05 13:58:00 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 13:58:00 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:58:00 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 13:58:00 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:58:00 user nova-compute[75233]:       <serial>9e8c7f28-31bb-4a30-91a5-36157799bcf4</serial>
Dec 05 13:58:00 user nova-compute[75233]:     </disk>
Dec 05 13:58:00 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:58:00 user nova-compute[75233]:       <mac address="fa:16:3e:71:49:1a"/>
Dec 05 13:58:00 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:58:00 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:58:00 user nova-compute[75233]:       <target dev="tap021bf74e-59"/>
Dec 05 13:58:00 user nova-compute[75233]:     </interface>
Dec 05 13:58:00 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:58:00 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/11fe694c-476e-465f-8b23-f8e2bffd7938/console.log" append="off"/>
Dec 05 13:58:00 user nova-compute[75233]:     </serial>
Dec 05 13:58:00 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:58:00 user nova-compute[75233]:     <video>
Dec 05 13:58:00 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:58:00 user nova-compute[75233]:     </video>
Dec 05 13:58:00 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:58:00 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:58:00 user nova-compute[75233]:     </rng>
Dec 05 13:58:00 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:58:00 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:58:00 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:58:00 user nova-compute[75233]:     </memballoon>
Dec 05 13:58:00 user nova-compute[75233]:   </devices>
Dec 05 13:58:00 user nova-compute[75233]: </domain>
Dec 05 13:58:00 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911532962',display_name='tempest-ServerActionsTestOtherA-server-911532962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911532962',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-l7i7d47w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=11fe694c-476e-465f-8b23-f8e2bffd7938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-881897716-network", "vif_mac": "fa:16:3e:71:49:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG os_vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e210984-811a-52cc-8747-3fbedbda3a3e', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap021bf74e-59, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap021bf74e-59, col_values=(('qos', UUID('fd0c1d32-8a6e-4773-ad12-c95c665ae021')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap021bf74e-59, col_values=(('external_ids', {'iface-id': '021bf74e-59c6-4e5b-92f0-5c75b594384e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:49:1a', 'vm-uuid': '11fe694c-476e-465f-8b23-f8e2bffd7938'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-4b070973-7d21-4519-8be0-4dae250fbe02 req-a9abd521-64f1-403d-9c5d-58f43fc50be7 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4b070973-7d21-4519-8be0-4dae250fbe02 req-a9abd521-64f1-403d-9c5d-58f43fc50be7 service nova] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4b070973-7d21-4519-8be0-4dae250fbe02 req-a9abd521-64f1-403d-9c5d-58f43fc50be7 service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4b070973-7d21-4519-8be0-4dae250fbe02 req-a9abd521-64f1-403d-9c5d-58f43fc50be7 service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-4b070973-7d21-4519-8be0-4dae250fbe02 req-a9abd521-64f1-403d-9c5d-58f43fc50be7 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] No waiting events found dispatching network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:00 user nova-compute[75233]: WARNING nova.compute.manager [req-4b070973-7d21-4519-8be0-4dae250fbe02 req-a9abd521-64f1-403d-9c5d-58f43fc50be7 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received unexpected event network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 for instance with vm_state building and task_state spawning.
Dec 05 13:58:00 user nova-compute[75233]: INFO os_vif [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59')
Dec 05 13:58:00 user nova-compute[75233]: INFO nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Took 5.27 seconds to spawn the instance on the hypervisor.
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] No VIF found with MAC fa:16:3e:71:49:1a, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:58:00 user nova-compute[75233]: INFO nova.compute.manager [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Took 6.05 seconds to build instance.
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3795dde9-c529-4a07-bfc9-77b8205f2945 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.139s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:04 user nova-compute[75233]: WARNING nova.compute.manager [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state resize_finish.
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:04 user nova-compute[75233]: WARNING nova.compute.manager [req-fdf19247-4aec-40ad-890e-a359813aca62 req-79cacaa2-b6de-4adb-b741-58d6148e48b6 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state resize_finish.
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:58:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:58:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=24.992046356201172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance running successfully.
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Failed to set time: agent not configured {{(pid=75233) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-afa66f99-f651-48f7-96fc-953b808602b6 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] finish_migration finished successfully. {{(pid=75233) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Applying migration context for instance 11fe694c-476e-465f-8b23-f8e2bffd7938 as it has an incoming, in-progress migration 078b29c2-2d27-4953-9317-d8e4abacac9c. Migration status is post-migrating {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 13:58:04 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating resource usage from migration 078b29c2-2d27-4953-9317-d8e4abacac9c
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 965d565d-b95b-4374-b28e-4a8180f4a702 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 164badc4-149a-40ce-b2b1-8b2718826466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Migration 078b29c2-2d27-4953-9317-d8e4abacac9c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:58:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:58:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:58:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:58:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:58:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:58:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:58:09 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:58:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "bdded23f-3fff-443e-af17-90145e598f9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:58:12 user nova-compute[75233]: INFO nova.compute.claims [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Claim successful on node user
Dec 05 13:58:12 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 965d565d-b95b-4374-b28e-4a8180f4a702 is timed out.
Dec 05 13:58:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully detached device vdb from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the live domain config.
Dec 05 13:58:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQsFtNa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:58:12 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:58:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399f9bf-fec6-4a87-ac19-811a4d04f02e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:58:12 user nova-compute[75233]: No targets found.
Dec 05 13:58:12 user nova-compute[75233]: iSNS:
Dec 05 13:58:12 user nova-compute[75233]: No targets found.
Dec 05 13:58:12 user nova-compute[75233]: STATIC:
Dec 05 13:58:12 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:58:12 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:12 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:12 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1
Dec 05 13:58:12 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:12 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:12 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f
Dec 05 13:58:12 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:12 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:12 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:58:12 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:12 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:12 user nova-compute[75233]: FIRMWARE:
Dec 05 13:58:12 user nova-compute[75233]: No targets found.
Dec 05 13:58:12 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:58:12 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:58:12 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb95556-63f1-457a-a4ad-e11ee7acac4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3f1960-2a75-405e-8eae-f19744121bbd]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:13 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:58:13 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:58:13 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:13 user nova-compute[75233]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f (non-flash)
Dec 05 13:58:13 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:58:13 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34742f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f'): ({'sdf'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Removing single pathed devices sdf {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f802bdfd-9bfe-4584-9dea-58ff642feb3c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[68361de7-7ae9-47ee-8a8c-c6bf57a4a55e]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flushing IO for device /dev/sdf {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f4b69-5392-4d90-9b52-b808d31c32d2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:58:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c9c56d-3ca7-40f2-b727-3e970d3efda8]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] SCSI volumes sdf have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9024a-2c9e-4d8b-ad06-5948313eb56b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.policy [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df61cbca359144e4a0c9ce81b51ebcee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd04a994cbca48239afebd5080f31725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0561bb24-6948-4d01-a21e-5b4e71794608]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260]
Dec 05 13:58:13 user nova-compute[75233]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f, portal: 172.16.0.220,3260] successful.
Dec 05 13:58:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 13:58:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Creating image(s)
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a53142-6b10-45b6-9057-5db0d2d1138f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6e658b-554a-4a96-9ec6-1ec4193e87fa]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.547s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== disconnect_volume: return (549ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk 1073741824" returned: 0 in 0.091s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Successfully created port: e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.221s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Cannot resize image /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Ensure instance console log exists: /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.objects.instance [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-409f358a-94dc-4b0f-8b90-7b530eb08447 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.128s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Successfully updated port: e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-changed-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Refreshing instance network info cache due to event network-changed-e07c77e5-9e0e-4e4a-a575-84eba30c9168. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] Acquiring lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Updating instance_info_cache with network_info: [{"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Instance network_info: |[{"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] Acquired lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Refreshing network info cache for port e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Start _get_guest_xml network_info=[{"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 13:58:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:58:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:58:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334555445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334555445',id=37,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-pb500caa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:58:13Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=bdded23f-3fff-443e-af17-90145e598f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.objects.instance [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'pci_devices' on Instance uuid bdded23f-3fff-443e-af17-90145e598f9e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:58:15 user nova-compute[75233]:   <uuid>bdded23f-3fff-443e-af17-90145e598f9e</uuid>
Dec 05 13:58:15 user nova-compute[75233]:   <name>instance-00000025</name>
Dec 05 13:58:15 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 13:58:15 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 13:58:15 user nova-compute[75233]:   <metadata>
Dec 05 13:58:15 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:58:15 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 13:58:15 user nova-compute[75233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-334555445</nova:name>
Dec 05 13:58:15 user nova-compute[75233]:       <nova:creationTime>2023-12-05 13:58:14</nova:creationTime>
Dec 05 13:58:15 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 13:58:15 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:58:15 user nova-compute[75233]:       </nova:flavor>
Dec 05 13:58:15 user nova-compute[75233]:       <nova:owner>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:user uuid="df61cbca359144e4a0c9ce81b51ebcee">tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member</nova:user>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:project uuid="bd04a994cbca48239afebd5080f31725">tempest-ServerBootFromVolumeStableRescueTest-264323439</nova:project>
Dec 05 13:58:15 user nova-compute[75233]:       </nova:owner>
Dec 05 13:58:15 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 13:58:15 user nova-compute[75233]:       <nova:ports>
Dec 05 13:58:15 user nova-compute[75233]:         <nova:port uuid="e07c77e5-9e0e-4e4a-a575-84eba30c9168">
Dec 05 13:58:15 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 13:58:15 user nova-compute[75233]:         </nova:port>
Dec 05 13:58:15 user nova-compute[75233]:       </nova:ports>
Dec 05 13:58:15 user nova-compute[75233]:     </nova:instance>
Dec 05 13:58:15 user nova-compute[75233]:   </metadata>
Dec 05 13:58:15 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 13:58:15 user nova-compute[75233]:     <system>
Dec 05 13:58:15 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:58:15 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:58:15 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 13:58:15 user nova-compute[75233]:       <entry name="serial">bdded23f-3fff-443e-af17-90145e598f9e</entry>
Dec 05 13:58:15 user nova-compute[75233]:       <entry name="uuid">bdded23f-3fff-443e-af17-90145e598f9e</entry>
Dec 05 13:58:15 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:58:15 user nova-compute[75233]:     </system>
Dec 05 13:58:15 user nova-compute[75233]:   </sysinfo>
Dec 05 13:58:15 user nova-compute[75233]:   <os>
Dec 05 13:58:15 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:58:15 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 13:58:15 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 13:58:15 user nova-compute[75233]:   </os>
Dec 05 13:58:15 user nova-compute[75233]:   <features>
Dec 05 13:58:15 user nova-compute[75233]:     <acpi/>
Dec 05 13:58:15 user nova-compute[75233]:     <apic/>
Dec 05 13:58:15 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 13:58:15 user nova-compute[75233]:   </features>
Dec 05 13:58:15 user nova-compute[75233]:   <clock offset="utc">
Dec 05 13:58:15 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:58:15 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:58:15 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 13:58:15 user nova-compute[75233]:   </clock>
Dec 05 13:58:15 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 13:58:15 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 13:58:15 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:58:15 user nova-compute[75233]:   </cpu>
Dec 05 13:58:15 user nova-compute[75233]:   <devices>
Dec 05 13:58:15 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 13:58:15 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 13:58:15 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk"/>
Dec 05 13:58:15 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 13:58:15 user nova-compute[75233]:     </disk>
Dec 05 13:58:15 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 13:58:15 user nova-compute[75233]:       <mac address="fa:16:3e:80:b5:c7"/>
Dec 05 13:58:15 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:58:15 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 13:58:15 user nova-compute[75233]:       <target dev="tape07c77e5-9e"/>
Dec 05 13:58:15 user nova-compute[75233]:     </interface>
Dec 05 13:58:15 user nova-compute[75233]:     <serial type="pty">
Dec 05 13:58:15 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/console.log" append="off"/>
Dec 05 13:58:15 user nova-compute[75233]:     </serial>
Dec 05 13:58:15 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:58:15 user nova-compute[75233]:     <video>
Dec 05 13:58:15 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 13:58:15 user nova-compute[75233]:     </video>
Dec 05 13:58:15 user nova-compute[75233]:     <rng model="virtio">
Dec 05 13:58:15 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:58:15 user nova-compute[75233]:     </rng>
Dec 05 13:58:15 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:58:15 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 13:58:15 user nova-compute[75233]:       <stats period="10"/>
Dec 05 13:58:15 user nova-compute[75233]:     </memballoon>
Dec 05 13:58:15 user nova-compute[75233]:   </devices>
Dec 05 13:58:15 user nova-compute[75233]: </domain>
Dec 05 13:58:15 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334555445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334555445',id=37,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-pb500caa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:58:13Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=bdded23f-3fff-443e-af17-90145e598f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG os_vif [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daa1e3e2-58d7-5bb2-93c8-777a08160256', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape07c77e5-9e, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape07c77e5-9e, col_values=(('qos', UUID('fa53437f-9c0a-492e-8ee8-872300d51e16')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape07c77e5-9e, col_values=(('external_ids', {'iface-id': 'e07c77e5-9e0e-4e4a-a575-84eba30c9168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:b5:c7', 'vm-uuid': 'bdded23f-3fff-443e-af17-90145e598f9e'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: INFO os_vif [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e')
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No VIF found with MAC fa:16:3e:80:b5:c7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:15 user nova-compute[75233]: INFO nova.compute.manager [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Detaching volume 89acc6f3-57c2-4929-856c-aa171db26ea1
Dec 05 13:58:15 user nova-compute[75233]: INFO nova.virt.block_device [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Attempting to driver detach volume 89acc6f3-57c2-4929-856c-aa171db26ea1 from mountpoint /dev/vdc
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Attempting to detach device vdc from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:58:15 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:58:15 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:58:15 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 13:58:15 user nova-compute[75233]:   <serial>89acc6f3-57c2-4929-856c-aa171db26ea1</serial>
Dec 05 13:58:15 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 13:58:15 user nova-compute[75233]: </disk>
Dec 05 13:58:15 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:58:15 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully detached device vdc from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the persistent domain config.
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:58:15 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:58:15 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:58:15 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 13:58:15 user nova-compute[75233]:   <serial>89acc6f3-57c2-4929-856c-aa171db26ea1</serial>
Dec 05 13:58:15 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 13:58:15 user nova-compute[75233]: </disk>
Dec 05 13:58:15 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Updated VIF entry in instance network info cache for port e07c77e5-9e0e-4e4a-a575-84eba30c9168. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Updating instance_info_cache with network_info: [{"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-422d29b0-4216-4cc3-b77a-5491ab0246f5 req-de22ad81-0b60-45df-bca8-e05e9c18a383 service nova] Releasing lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:15 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-87eac9b8-1f87-4bd7-9941-d3934af0f74d req-20916aba-87cf-4655-b919-a68a778f63f1 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-87eac9b8-1f87-4bd7-9941-d3934af0f74d req-20916aba-87cf-4655-b919-a68a778f63f1 service nova] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-87eac9b8-1f87-4bd7-9941-d3934af0f74d req-20916aba-87cf-4655-b919-a68a778f63f1 service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-87eac9b8-1f87-4bd7-9941-d3934af0f74d req-20916aba-87cf-4655-b919-a68a778f63f1 service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-87eac9b8-1f87-4bd7-9941-d3934af0f74d req-20916aba-87cf-4655-b919-a68a778f63f1 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] No waiting events found dispatching network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:16 user nova-compute[75233]: WARNING nova.compute.manager [req-87eac9b8-1f87-4bd7-9941-d3934af0f74d req-20916aba-87cf-4655-b919-a68a778f63f1 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received unexpected event network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 for instance with vm_state building and task_state spawning.
Dec 05 13:58:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:58:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Instance spawned successfully.
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:58:18 user nova-compute[75233]: INFO nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Took 5.51 seconds to spawn the instance on the hypervisor.
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-adb3428b-b3bc-4359-ba06-c4b149d1abdf req-fde403f2-8d33-4890-a529-87dd51a3e167 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adb3428b-b3bc-4359-ba06-c4b149d1abdf req-fde403f2-8d33-4890-a529-87dd51a3e167 service nova] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adb3428b-b3bc-4359-ba06-c4b149d1abdf req-fde403f2-8d33-4890-a529-87dd51a3e167 service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adb3428b-b3bc-4359-ba06-c4b149d1abdf req-fde403f2-8d33-4890-a529-87dd51a3e167 service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-adb3428b-b3bc-4359-ba06-c4b149d1abdf req-fde403f2-8d33-4890-a529-87dd51a3e167 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] No waiting events found dispatching network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:18 user nova-compute[75233]: WARNING nova.compute.manager [req-adb3428b-b3bc-4359-ba06-c4b149d1abdf req-fde403f2-8d33-4890-a529-87dd51a3e167 service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received unexpected event network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 for instance with vm_state building and task_state spawning.
Dec 05 13:58:18 user nova-compute[75233]: INFO nova.compute.manager [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Took 6.42 seconds to build instance.
Dec 05 13:58:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-83f9dada-f22c-48e1-a633-5cba82d66dac tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "bdded23f-3fff-443e-af17-90145e598f9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.533s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:29 user nova-compute[75233]: INFO nova.compute.manager [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attaching volume fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed to /dev/vdb
Dec 05 13:58:29 user nova-compute[75233]: DEBUG os_brick.utils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[342638e6-5884-4fa8-b93e-425198717db4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77bb641-65d9-4a86-ac16-8468a74815a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[32135877-22f8-4d78-b253-6a920eabbd15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f96397e-f5c9-4d29-a968-c00276b5c698]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:58:29 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:58:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d705092-5d79-4d59-8233-25e2bd51cb0b]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG os_brick.utils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:58:29 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating existing volume attachment record: a8289e3b-27f8-412e-89b4-8f5e8dc73e49 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:58:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 965d565d-b95b-4374-b28e-4a8180f4a702 is timed out.
Dec 05 13:58:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully detached device vdc from instance 965d565d-b95b-4374-b28e-4a8180f4a702 from the live domain config.
Dec 05 13:58:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muMbQDyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:58:35 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[438af996-49c0-4de7-9cd9-8277afb389a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:58:35 user nova-compute[75233]: No targets found.
Dec 05 13:58:35 user nova-compute[75233]: iSNS:
Dec 05 13:58:35 user nova-compute[75233]: No targets found.
Dec 05 13:58:35 user nova-compute[75233]: STATIC:
Dec 05 13:58:35 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:58:35 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:35 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:35 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1
Dec 05 13:58:35 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:35 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:35 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:58:35 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:58:35 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:58:35 user nova-compute[75233]: FIRMWARE:
Dec 05 13:58:35 user nova-compute[75233]: No targets found.
Dec 05 13:58:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:58:35 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:58:35 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee8f00-5fe3-46fe-8d5a-9e7bbf4dc0c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5a7c4f-c599-408c-b1b9-8825819b44c1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:35 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:58:35 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:35 user nova-compute[75233]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 (non-flash)
Dec 05 13:58:35 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:35 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f603ee830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13171b0b-2798-4391-8e4b-fb4fa698e722]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b40da-6abd-4834-bfb6-34abbb584613]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a0f499-caa4-4ae0-9fe5-d41333e631b9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634dbb0-deee-41d3-9c23-2c04595eeb59]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e4f59b-0fd4-43d1-adaf-34587b1c7bd6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[18931587-78e1-4b56-8d55-2efa637a9fcf]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260]
Dec 05 13:58:36 user nova-compute[75233]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1, portal: 172.16.0.220,3260] successful.
Dec 05 13:58:36 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89acc6f3-57c2-4929-856c-aa171db26ea1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0ad84-b11a-447c-8963-4ed0e518f4c8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] <== disconnect_volume: return (292ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:58:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'flavor' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-720abfc7-c8a9-4471-be70-424eba918096 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.715s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MihkdZHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:58:39 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:58:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:58:39 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:58:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:58:39 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:58:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[037067e7-3923-4b31-ae78-02abdacfdcea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:58:39 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[58922d7e-c955-40bf-aa5d-92838ffac1b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed] added
Dec 05 13:58:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e8566-4df0-4480-a5ff-69ecce8518eb]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d469993-8449-43c1-a934-4a50cef5eae6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MihkdZHa {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MihkdZHa" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0c48a0-1314-4ddd-972f-9f4fe807ec23]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MihkdZHa'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eea938-17c9-4391-b669-f309e7c80376]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4680c-6f46-4311-ae4a-0f47934d7d7b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:40 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:40 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71414da-6a4c-4297-8539-fd61925716a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260]
Dec 05 13:58:40 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260] successful.
Dec 05 13:58:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3cd92a-a8d4-4e5f-81fb-66f9a2780ba8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d3c652-8448-4f9b-8ca3-295950dd1baa]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:40 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:40 user nova-compute[75233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed (non-flash)
Dec 05 13:58:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:58:40 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:58:40 user nova-compute[75233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed (non-flash)
Dec 05 13:58:40 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e914f10-3c32-4b01-a7b6-e6bb22881807]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MihkdZHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:58:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:41 user nova-compute[75233]: INFO nova.compute.manager [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Terminating instance
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23236383531313734', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236383531313734', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 13:58:41 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:58:41 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:58:41 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:58:41 user nova-compute[75233]:   <serial>fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed</serial>
Dec 05 13:58:41 user nova-compute[75233]: </disk>
Dec 05 13:58:41 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-575aaf2f-4ae5-458d-ac9b-8a8ee3faddef req-05610311-215d-4436-b0b8-edaee5b95599 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-vif-unplugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-575aaf2f-4ae5-458d-ac9b-8a8ee3faddef req-05610311-215d-4436-b0b8-edaee5b95599 service nova] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-575aaf2f-4ae5-458d-ac9b-8a8ee3faddef req-05610311-215d-4436-b0b8-edaee5b95599 service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-575aaf2f-4ae5-458d-ac9b-8a8ee3faddef req-05610311-215d-4436-b0b8-edaee5b95599 service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-575aaf2f-4ae5-458d-ac9b-8a8ee3faddef req-05610311-215d-4436-b0b8-edaee5b95599 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] No waiting events found dispatching network-vif-unplugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-575aaf2f-4ae5-458d-ac9b-8a8ee3faddef req-05610311-215d-4436-b0b8-edaee5b95599 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-vif-unplugged-6f867925-1c09-4a2a-9307-07c5a473ae74 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] No VIF found with MAC fa:16:3e:5b:80:e7, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 13:58:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6ed3c4dd-87ef-47b5-89d9-85258dae45c6 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.445s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Instance destroyed successfully.
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.objects.instance [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lazy-loading 'resources' on Instance uuid 965d565d-b95b-4374-b28e-4a8180f4a702 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1710911232',display_name='tempest-AttachVolumeTestJSON-server-1710911232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1710911232',id=33,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG7XW+Y7GaDKokWwropXez/5XzsRmyYTRZFAmzrOrR7Sjt+UZTwSYT2pjKs8R1fdaMWBtZcA5/CqOC0IFKStNJ4u/qlRin3a6cecyefNgnGYcXJ4zyqiDLyUCBgJPqTQw==',key_name='tempest-keypair-223770753',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:55:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14235050c7d84ebb8ff12ff245c35fec',ramdisk_id='',reservation_id='r-y4ast2e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1807043870',owner_user_name='tempest-AttachVolumeTestJSON-1807043870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:55:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6a3445087d842fc9279e2472759bf1f',uuid=965d565d-b95b-4374-b28e-4a8180f4a702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converting VIF {"id": "6f867925-1c09-4a2a-9307-07c5a473ae74", "address": "fa:16:3e:31:ef:04", "network": {"id": "549d80db-c983-4cf9-97f5-67b5d15261cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-949349769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14235050c7d84ebb8ff12ff245c35fec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f867925-1c", "ovs_interfaceid": "6f867925-1c09-4a2a-9307-07c5a473ae74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG os_vif [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f867925-1c, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94527438-2918-47d9-93ab-77c5ba92cc80) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:42 user nova-compute[75233]: INFO os_vif [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ef:04,bridge_name='br-int',has_traffic_filtering=True,id=6f867925-1c09-4a2a-9307-07c5a473ae74,network=Network(549d80db-c983-4cf9-97f5-67b5d15261cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f867925-1c')
Dec 05 13:58:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Deleting instance files /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702_del
Dec 05 13:58:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Deletion of /opt/stack/data/nova/instances/965d565d-b95b-4374-b28e-4a8180f4a702_del complete
Dec 05 13:58:42 user nova-compute[75233]: INFO nova.compute.manager [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 05 13:58:42 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:58:42 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Took 0.80 seconds to deallocate network for instance.
Dec 05 13:58:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-ec529fd8-4e19-43c7-8fa3-86a20da0a527 req-9a1e2fe3-b423-47ed-bf01-ee47a60d22e4 service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-vif-deleted-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:43 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Deleted allocations for instance 965d565d-b95b-4374-b28e-4a8180f4a702
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-09aa9499-5591-4076-8f3a-a6deda2b4d10 tempest-AttachVolumeTestJSON-1807043870 tempest-AttachVolumeTestJSON-1807043870-project-member] Lock "965d565d-b95b-4374-b28e-4a8180f4a702" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.183s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-8a22e66f-1c3b-48cd-8eeb-000d9ba154f4 req-d064cb6e-4d19-49c6-8f74-c7fb4dcb2f6c service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received event network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8a22e66f-1c3b-48cd-8eeb-000d9ba154f4 req-d064cb6e-4d19-49c6-8f74-c7fb4dcb2f6c service nova] Acquiring lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8a22e66f-1c3b-48cd-8eeb-000d9ba154f4 req-d064cb6e-4d19-49c6-8f74-c7fb4dcb2f6c service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8a22e66f-1c3b-48cd-8eeb-000d9ba154f4 req-d064cb6e-4d19-49c6-8f74-c7fb4dcb2f6c service nova] Lock "965d565d-b95b-4374-b28e-4a8180f4a702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-8a22e66f-1c3b-48cd-8eeb-000d9ba154f4 req-d064cb6e-4d19-49c6-8f74-c7fb4dcb2f6c service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] No waiting events found dispatching network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:58:43 user nova-compute[75233]: WARNING nova.compute.manager [req-8a22e66f-1c3b-48cd-8eeb-000d9ba154f4 req-d064cb6e-4d19-49c6-8f74-c7fb4dcb2f6c service nova] [instance: 965d565d-b95b-4374-b28e-4a8180f4a702] Received unexpected event network-vif-plugged-6f867925-1c09-4a2a-9307-07c5a473ae74 for instance with vm_state deleted and task_state None.
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:43 user nova-compute[75233]: INFO nova.compute.manager [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Detaching volume fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed
Dec 05 13:58:44 user nova-compute[75233]: INFO nova.virt.block_device [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Attempting to driver detach volume fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed from mountpoint /dev/vdb
Dec 05 13:58:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Attempting to detach device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:58:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:58:44 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:58:44 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:58:44 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:58:44 user nova-compute[75233]:   <serial>fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed</serial>
Dec 05 13:58:44 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:58:44 user nova-compute[75233]: </disk>
Dec 05 13:58:44 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:58:44 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the persistent domain config.
Dec 05 13:58:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:58:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:58:44 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:58:44 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 13:58:44 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:58:44 user nova-compute[75233]:   <serial>fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed</serial>
Dec 05 13:58:44 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:58:44 user nova-compute[75233]: </disk>
Dec 05 13:58:44 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:58:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:58:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:58:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:58:59 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:58:59 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=24.95175552368164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Applying migration context for instance 11fe694c-476e-465f-8b23-f8e2bffd7938 as it has an incoming, in-progress migration 078b29c2-2d27-4953-9317-d8e4abacac9c. Migration status is finished {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 13:58:59 user nova-compute[75233]: INFO nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating resource usage from migration 078b29c2-2d27-4953-9317-d8e4abacac9c
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 164badc4-149a-40ce-b2b1-8b2718826466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Migration 078b29c2-2d27-4953-9317-d8e4abacac9c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:58:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:59:00 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:59:00 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:59:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:59:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:59:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:59:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:59:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e is timed out.
Dec 05 13:59:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully detached device vdb from instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e from the live domain config.
Dec 05 13:59:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MihkdZHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:59:04 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b66f442-385c-4254-8dc4-8a9b3b8a8a8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:59:04 user nova-compute[75233]: No targets found.
Dec 05 13:59:04 user nova-compute[75233]: iSNS:
Dec 05 13:59:04 user nova-compute[75233]: No targets found.
Dec 05 13:59:04 user nova-compute[75233]: STATIC:
Dec 05 13:59:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 13:59:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:59:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:59:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 13:59:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:59:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:59:04 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed
Dec 05 13:59:04 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:59:04 user nova-compute[75233]:                 Iface Name: default
Dec 05 13:59:04 user nova-compute[75233]: FIRMWARE:
Dec 05 13:59:04 user nova-compute[75233]: No targets found.
Dec 05 13:59:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:59:04 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:59:04 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c69ea05-526f-466f-8265-2cda15a7faa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[122b496b-d429-45ee-aa75-ff011da7e657]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:59:04 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:59:04 user nova-compute[75233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed (non-flash)
Dec 05 13:59:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:59:04 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:59:04 user nova-compute[75233]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed (non-flash)
Dec 05 13:59:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f6a1e3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d69e8c4-4991-4580-bbce-b0c4d5860d4f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13b2706-d4bc-4d57-a8bd-211bb8233b54]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1bf555-d071-4c3a-a62e-20e3795a8f3c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33f3e90-6c6f-478f-9007-5b7041d0cc51]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5612ee92-f156-45ef-b003-df9df76c2987]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3d40c-f506-4617-9b97-5f993dd308f7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260]
Dec 05 13:59:04 user nova-compute[75233]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed, portal: 172.16.0.220,3260] successful.
Dec 05 13:59:04 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc3d9b32-bb0e-4de3-98f4-b7b41303a7ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f62991b-a016-4739-a3fc-24b170a073b6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] <== disconnect_volume: return (335ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:59:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:59:05 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'flavor' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:59:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0676d34-5b76-4151-9baa-01fa947f1603 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:59:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:59:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:59:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:59:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:59:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:59:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating instance_info_cache with network_info: [{"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:59:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-a4f836f8-55ae-46c1-8b66-31fb61d06b3e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:59:09 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "164badc4-149a-40ce-b2b1-8b2718826466" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:12 user nova-compute[75233]: INFO nova.compute.manager [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Terminating instance
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e1e33ea-b269-4fb1-9520-c723410d0d48 req-12fabe8d-4b92-49f8-b52c-c7e7acc5eb10 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-vif-unplugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e1e33ea-b269-4fb1-9520-c723410d0d48 req-12fabe8d-4b92-49f8-b52c-c7e7acc5eb10 service nova] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e1e33ea-b269-4fb1-9520-c723410d0d48 req-12fabe8d-4b92-49f8-b52c-c7e7acc5eb10 service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e1e33ea-b269-4fb1-9520-c723410d0d48 req-12fabe8d-4b92-49f8-b52c-c7e7acc5eb10 service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e1e33ea-b269-4fb1-9520-c723410d0d48 req-12fabe8d-4b92-49f8-b52c-c7e7acc5eb10 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] No waiting events found dispatching network-vif-unplugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e1e33ea-b269-4fb1-9520-c723410d0d48 req-12fabe8d-4b92-49f8-b52c-c7e7acc5eb10 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-vif-unplugged-aeb38706-5f6e-43f3-be7f-4476e668841c for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:59:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Instance destroyed successfully.
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.objects.instance [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lazy-loading 'resources' on Instance uuid 164badc4-149a-40ce-b2b1-8b2718826466 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-789235084',display_name='tempest-VolumesActionsTest-instance-789235084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-789235084',id=35,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d68724e2b4d34134abad8a99fc3d562b',ramdisk_id='',reservation_id='r-p6ea5s9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2088742372',owner_user_name='tempest-VolumesActionsTest-2088742372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:57:21Z,user_data=None,user_id='d4e481441e684d12bdda2cd1b17ccd72',uuid=164badc4-149a-40ce-b2b1-8b2718826466,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Converting VIF {"id": "aeb38706-5f6e-43f3-be7f-4476e668841c", "address": "fa:16:3e:f4:75:e9", "network": {"id": "cdac1dbf-e5c1-46f2-9277-dd72c51016db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1661175969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68724e2b4d34134abad8a99fc3d562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeb38706-5f", "ovs_interfaceid": "aeb38706-5f6e-43f3-be7f-4476e668841c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG os_vif [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeb38706-5f, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd979553-a0f6-445f-819d-6ceeda96d3bb) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:59:12 user nova-compute[75233]: INFO os_vif [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:75:e9,bridge_name='br-int',has_traffic_filtering=True,id=aeb38706-5f6e-43f3-be7f-4476e668841c,network=Network(cdac1dbf-e5c1-46f2-9277-dd72c51016db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeb38706-5f')
Dec 05 13:59:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Deleting instance files /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466_del
Dec 05 13:59:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Deletion of /opt/stack/data/nova/instances/164badc4-149a-40ce-b2b1-8b2718826466_del complete
Dec 05 13:59:13 user nova-compute[75233]: INFO nova.compute.manager [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Took 0.65 seconds to destroy the instance on the hypervisor.
Dec 05 13:59:13 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:59:13 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Took 0.42 seconds to deallocate network for instance.
Dec 05 13:59:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-97a4e3f1-b3a6-4362-8dee-941093e6ffa0 req-cb7282b5-6e8d-4687-b42e-eee09028d7cb service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-vif-deleted-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:59:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:13 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Deleted allocations for instance 164badc4-149a-40ce-b2b1-8b2718826466
Dec 05 13:59:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-77353101-e062-47c4-bf51-06f493aefb18 tempest-VolumesActionsTest-2088742372 tempest-VolumesActionsTest-2088742372-project-member] Lock "164badc4-149a-40ce-b2b1-8b2718826466" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-70222689-2fc2-44c1-aa2a-1dfecda4449e req-fe8dd573-d0e0-45d8-848c-2664aad704e6 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received event network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:59:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-70222689-2fc2-44c1-aa2a-1dfecda4449e req-fe8dd573-d0e0-45d8-848c-2664aad704e6 service nova] Acquiring lock "164badc4-149a-40ce-b2b1-8b2718826466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-70222689-2fc2-44c1-aa2a-1dfecda4449e req-fe8dd573-d0e0-45d8-848c-2664aad704e6 service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-70222689-2fc2-44c1-aa2a-1dfecda4449e req-fe8dd573-d0e0-45d8-848c-2664aad704e6 service nova] Lock "164badc4-149a-40ce-b2b1-8b2718826466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-70222689-2fc2-44c1-aa2a-1dfecda4449e req-fe8dd573-d0e0-45d8-848c-2664aad704e6 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] No waiting events found dispatching network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:59:14 user nova-compute[75233]: WARNING nova.compute.manager [req-70222689-2fc2-44c1-aa2a-1dfecda4449e req-fe8dd573-d0e0-45d8-848c-2664aad704e6 service nova] [instance: 164badc4-149a-40ce-b2b1-8b2718826466] Received unexpected event network-vif-plugged-aeb38706-5f6e-43f3-be7f-4476e668841c for instance with vm_state deleted and task_state None.
Dec 05 13:59:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:59:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Going to confirm migration 2 {{(pid=75233) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquired lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:59:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'info_cache' on Instance uuid 11fe694c-476e-465f-8b23-f8e2bffd7938 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [{"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Releasing lock "refresh_cache-11fe694c-476e-465f-8b23-f8e2bffd7938" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'migration_context' on Instance uuid 11fe694c-476e-465f-8b23-f8e2bffd7938 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG nova.objects.base [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Object Instance<11fe694c-476e-465f-8b23-f8e2bffd7938> lazy-loaded attributes: info_cache,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:59:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.375s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:34 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Deleted allocation for migration 078b29c2-2d27-4953-9317-d8e4abacac9c
Dec 05 13:59:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e64c4007-4d65-4b5a-904a-08d71365ffe9 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.427s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:59:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:59:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:59:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:59:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-changed-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:59:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Refreshing instance network info cache due to event network-changed-6cf187fe-1d84-43d1-95ec-d07db6ca0b77. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:59:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] Acquiring lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:59:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] Acquired lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:59:45 user nova-compute[75233]: DEBUG nova.network.neutron [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Refreshing network info cache for port 6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:59:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:46 user nova-compute[75233]: DEBUG nova.network.neutron [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updated VIF entry in instance network info cache for port 6cf187fe-1d84-43d1-95ec-d07db6ca0b77. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:59:46 user nova-compute[75233]: DEBUG nova.network.neutron [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updating instance_info_cache with network_info: [{"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:59:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5734819e-8106-4ac1-ac1e-9983d20aa5b8 req-d42b3c09-3d4a-4ad1-a01e-59a88d9f0254 service nova] Releasing lock "refresh_cache-64b8a85a-9a06-4f5d-ace7-0d0b331c0768" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:59:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:48 user nova-compute[75233]: INFO nova.compute.manager [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Attaching volume 2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 to /dev/vdb
Dec 05 13:59:48 user nova-compute[75233]: DEBUG os_brick.utils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a4a72-b9b3-4723-a215-06ef3177f96f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3972b76-2860-4bb9-bef2-0e1bfb840155]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaf69a3-a944-4254-b095-69f2535ea581]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[041cd695-ef45-436e-a5f2-518208d21c4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:59:48 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:59:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76ba17f-9696-4647-a60a-961664be3115]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG os_brick.utils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updating existing volume attachment record: a3de8f0b-6771-4a1e-b5d1-b1408afc0111 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:59:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:59:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:59:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 13:59:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftiesohV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:59:58 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:59:58 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:59:58 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b20e54-5a3c-4e10-ba0a-d30587fe7a15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:59:58 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a75f05-c7c6-4939-a64c-6ebd91c22ef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4] added
Dec 05 13:59:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a0c085-0a90-45ed-adcf-4604fe0d3c97]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb6173-ebf0-47c8-8671-c000efb85f8a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftiesohV {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftiesohV" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f4186-4ef4-4ff2-8135-7222daf8a58a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftiesohV'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03def5f3-d6ec-4375-b841-989741c04843]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5a832-b0ce-420b-8fd7-f98fa04006bd]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:59:58 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:59:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:59:58 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:59:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7ad22-0b5b-4fc6-9b9a-e5810f810a53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260]
Dec 05 13:59:58 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260] successful.
Dec 05 13:59:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e890aa-9630-40d1-8485-ba5db78a2014]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a846c0a7-20d6-4390-8d46-c986537dc3ff]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:59:58 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:59:58 user nova-compute[75233]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 (non-flash)
Dec 05 13:59:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 13:59:58 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 13:59:58 user nova-compute[75233]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 (non-flash)
Dec 05 13:59:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e49e026-1785-431b-b393-4d25a76181b5]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:59:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftiesohV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:59:59 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:59:59 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=24.969284057617188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26635356436326332', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635356436326332', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:59:59 user nova-compute[75233]: DEBUG nova.objects.instance [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:00:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:00:00 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:00:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:00:00 user nova-compute[75233]:   <serial>2b149aa8-66bd-4ed9-8068-ca16ea5beaf4</serial>
Dec 05 14:00:00 user nova-compute[75233]: </disk>
Dec 05 14:00:00 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] No VIF found with MAC fa:16:3e:6c:03:e3, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.820s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-066872de-c691-496b-a2bf-0278182109ce tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.094s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:01 user nova-compute[75233]: INFO nova.compute.manager [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Detaching volume 2b149aa8-66bd-4ed9-8068-ca16ea5beaf4
Dec 05 14:00:01 user nova-compute[75233]: INFO nova.virt.block_device [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Attempting to driver detach volume 2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 from mountpoint /dev/vdb
Dec 05 14:00:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Attempting to detach device vdb from instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:00:01 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:00:01 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:00:01 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:00:01 user nova-compute[75233]:   <serial>2b149aa8-66bd-4ed9-8068-ca16ea5beaf4</serial>
Dec 05 14:00:01 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:00:01 user nova-compute[75233]: </disk>
Dec 05 14:00:01 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:00:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully detached device vdb from instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 from the persistent domain config.
Dec 05 14:00:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:00:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:00:01 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:00:01 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:00:01 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:00:01 user nova-compute[75233]:   <serial>2b149aa8-66bd-4ed9-8068-ca16ea5beaf4</serial>
Dec 05 14:00:01 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:00:01 user nova-compute[75233]: </disk>
Dec 05 14:00:01 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:00:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:00:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:00:03 user nova-compute[75233]: INFO nova.compute.manager [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] instance snapshotting
Dec 05 14:00:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Beginning live snapshot process
Dec 05 14:00:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json -f qcow2" returned: 0 in 0.247s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplnwjt0q3/c0cde7995b1940268e62468994ef28b0.delta 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplnwjt0q3/c0cde7995b1940268e62468994ef28b0.delta 1073741824" returned: 0 in 0.062s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 14:00:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 14:00:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 14:00:05 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 14:00:06 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:00:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplnwjt0q3/c0cde7995b1940268e62468994ef28b0.delta /opt/stack/data/nova/instances/snapshots/tmplnwjt0q3/c0cde7995b1940268e62468994ef28b0 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplnwjt0q3/c0cde7995b1940268e62468994ef28b0.delta /opt/stack/data/nova/instances/snapshots/tmplnwjt0q3/c0cde7995b1940268e62468994ef28b0" returned: 0 in 0.350s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:06 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Snapshot extracted, beginning image upload
Dec 05 14:00:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:00:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Snapshot image upload complete
Dec 05 14:00:09 user nova-compute[75233]: INFO nova.compute.manager [None req-2138ed55-7ac0-4f68-a683-e7ff88ca4bfb tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Took 5.38 seconds to snapshot the instance on the hypervisor.
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:09 user nova-compute[75233]: INFO nova.compute.manager [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Terminating instance
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-24756325-701c-47bd-aa0b-f69e0dac0b20 req-cad83261-f8fd-444e-b0cb-7c332c855985 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-vif-unplugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-24756325-701c-47bd-aa0b-f69e0dac0b20 req-cad83261-f8fd-444e-b0cb-7c332c855985 service nova] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-24756325-701c-47bd-aa0b-f69e0dac0b20 req-cad83261-f8fd-444e-b0cb-7c332c855985 service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-24756325-701c-47bd-aa0b-f69e0dac0b20 req-cad83261-f8fd-444e-b0cb-7c332c855985 service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-24756325-701c-47bd-aa0b-f69e0dac0b20 req-cad83261-f8fd-444e-b0cb-7c332c855985 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] No waiting events found dispatching network-vif-unplugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-24756325-701c-47bd-aa0b-f69e0dac0b20 req-cad83261-f8fd-444e-b0cb-7c332c855985 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-vif-unplugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:00:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Instance destroyed successfully.
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.objects.instance [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lazy-loading 'resources' on Instance uuid a4f836f8-55ae-46c1-8b66-31fb61d06b3e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-84227660',display_name='tempest-SnapshotDataIntegrityTests-server-84227660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-84227660',id=29,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyQmHBSLKw2U+MhyRP67gsK0Go2JajBCsKIzNkcJRPFLJo+LmkkGB0VWaBSfhVqvc7gbQfrTZSmS5RZECRaxaVYmPIWogPWQuGFwBbIxSNBzxnqNpzkJpxxlaCstj6tew==',key_name='tempest-keypair-2070929162',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd5ca89f82f548b3b6a23c5f56a65051',ramdisk_id='',reservation_id='r-nmlctw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1595189290',owner_user_name='tempest-SnapshotDataIntegrityTests-1595189290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18b742f965294f9cb81174161e2b0764',uuid=a4f836f8-55ae-46c1-8b66-31fb61d06b3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Converting VIF {"id": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "address": "fa:16:3e:5b:80:e7", "network": {"id": "b7730b40-b1b5-4257-80b3-e3c8da0f0204", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-606392679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd5ca89f82f548b3b6a23c5f56a65051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51e2cb3-79", "ovs_interfaceid": "c51e2cb3-79fc-4a6d-affb-24652036b3cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG os_vif [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc51e2cb3-79, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5989e8a1-85a9-48e3-965c-7f4760c33722) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:09 user nova-compute[75233]: INFO os_vif [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:80:e7,bridge_name='br-int',has_traffic_filtering=True,id=c51e2cb3-79fc-4a6d-affb-24652036b3cc,network=Network(b7730b40-b1b5-4257-80b3-e3c8da0f0204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc51e2cb3-79')
Dec 05 14:00:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Deleting instance files /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e_del
Dec 05 14:00:09 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Deletion of /opt/stack/data/nova/instances/a4f836f8-55ae-46c1-8b66-31fb61d06b3e_del complete
Dec 05 14:00:10 user nova-compute[75233]: INFO nova.compute.manager [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Took 1.07 seconds to destroy the instance on the hypervisor.
Dec 05 14:00:10 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:00:10 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:00:11 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Took 1.01 seconds to deallocate network for instance.
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updating instance_info_cache with network_info: [{"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-05d8a032-7b26-4106-afe5-4bc5b811388a" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:11 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Deleted allocations for instance a4f836f8-55ae-46c1-8b66-31fb61d06b3e
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] Acquiring lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] No waiting events found dispatching network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:00:11 user nova-compute[75233]: WARNING nova.compute.manager [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received unexpected event network-vif-plugged-c51e2cb3-79fc-4a6d-affb-24652036b3cc for instance with vm_state deleted and task_state None.
Dec 05 14:00:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-8f8af767-ce75-45aa-b6fc-879f8c3b02db req-17d973f0-dbee-4956-8a46-21dbea8d6901 service nova] [instance: a4f836f8-55ae-46c1-8b66-31fb61d06b3e] Received event network-vif-deleted-c51e2cb3-79fc-4a6d-affb-24652036b3cc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:00:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2edea539-a5fd-4540-a266-29d97ac72919 tempest-SnapshotDataIntegrityTests-1595189290 tempest-SnapshotDataIntegrityTests-1595189290-project-member] Lock "a4f836f8-55ae-46c1-8b66-31fb61d06b3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 is timed out.
Dec 05 14:00:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully detached device vdb from instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 from the live domain config.
Dec 05 14:00:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftiesohV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:00:22 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34858af-78cb-4eeb-9f7d-0b0106459566]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:00:22 user nova-compute[75233]: No targets found.
Dec 05 14:00:22 user nova-compute[75233]: iSNS:
Dec 05 14:00:22 user nova-compute[75233]: No targets found.
Dec 05 14:00:22 user nova-compute[75233]: STATIC:
Dec 05 14:00:22 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 14:00:22 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:00:22 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:00:22 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 14:00:22 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:00:22 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:00:22 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4
Dec 05 14:00:22 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:00:22 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:00:22 user nova-compute[75233]: FIRMWARE:
Dec 05 14:00:22 user nova-compute[75233]: No targets found.
Dec 05 14:00:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:00:22 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:00:22 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa8e8ab-07a6-4b68-8b4a-f4a196c0fc6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d6e6a-7a39-4329-924c-1766d95b2ec8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:00:22 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:00:22 user nova-compute[75233]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 (non-flash)
Dec 05 14:00:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:00:22 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:00:22 user nova-compute[75233]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 (non-flash)
Dec 05 14:00:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f585e5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f29c78-66c0-4e88-af24-c031687bdd68]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[787f3ce1-d83a-4070-8f89-1288ca23c198]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f211c9-1621-4fc4-a4c5-0a10d29c8149]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f1e10b-143e-4f17-90e3-26a3995be2bc]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2837ecbd-6841-4d30-827b-73bde0b2c2fc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b497f6d-4d65-4df6-855d-5019228de82e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260]
Dec 05 14:00:22 user nova-compute[75233]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4, portal: 172.16.0.220,3260] successful.
Dec 05 14:00:22 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b149aa8-66bd-4ed9-8068-ca16ea5beaf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[353e016e-83c9-4c02-838b-392279cba4bd]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] <== disconnect_volume: return (315ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:00:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:00:23 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'flavor' on Instance uuid 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:00:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0ce8f300-af20-4456-8f72-7ae9aa8da882 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.783s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:00:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:00:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:00:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:00:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:00:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:00:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:52 user nova-compute[75233]: INFO nova.compute.manager [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Terminating instance
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-bdd605d5-d1b6-4a15-8a36-a9ece364db33 req-71ab1ceb-1cf9-4110-a01f-743de56f9c0d service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-vif-unplugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bdd605d5-d1b6-4a15-8a36-a9ece364db33 req-71ab1ceb-1cf9-4110-a01f-743de56f9c0d service nova] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bdd605d5-d1b6-4a15-8a36-a9ece364db33 req-71ab1ceb-1cf9-4110-a01f-743de56f9c0d service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bdd605d5-d1b6-4a15-8a36-a9ece364db33 req-71ab1ceb-1cf9-4110-a01f-743de56f9c0d service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-bdd605d5-d1b6-4a15-8a36-a9ece364db33 req-71ab1ceb-1cf9-4110-a01f-743de56f9c0d service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] No waiting events found dispatching network-vif-unplugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-bdd605d5-d1b6-4a15-8a36-a9ece364db33 req-71ab1ceb-1cf9-4110-a01f-743de56f9c0d service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-vif-unplugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Instance destroyed successfully.
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.objects.instance [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lazy-loading 'resources' on Instance uuid 64b8a85a-9a06-4f5d-ace7-0d0b331c0768 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687533200',display_name='tempest-AttachVolumeNegativeTest-server-687533200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687533200',id=36,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMv3aisDFowgPlPq9kc9tUf7Fd2ak67uzKLrGpfC4SUY6GyBrDffsptEFzEoj1SOXpgz8xl9FzKZk4jvBXYsRfHmrYC0QbJ+nmuJ+/ZR2G50Vx37opLV7L9i+wH1uGDOw==',key_name='tempest-keypair-1000860518',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:58:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f73a22149826499ba7d03f47ce7375cd',ramdisk_id='',reservation_id='r-qle7ijut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-525245035',owner_user_name='tempest-AttachVolumeNegativeTest-525245035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebeefb2fa465406b911b62137057223a',uuid=64b8a85a-9a06-4f5d-ace7-0d0b331c0768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converting VIF {"id": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "address": "fa:16:3e:6c:03:e3", "network": {"id": "9779f23d-dacb-404a-b0a7-673eb9988685", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1237283793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f73a22149826499ba7d03f47ce7375cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf187fe-1d", "ovs_interfaceid": "6cf187fe-1d84-43d1-95ec-d07db6ca0b77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG os_vif [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cf187fe-1d, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9644411d-c7cd-4674-a33a-66f3473dba26) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:52 user nova-compute[75233]: INFO os_vif [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:03:e3,bridge_name='br-int',has_traffic_filtering=True,id=6cf187fe-1d84-43d1-95ec-d07db6ca0b77,network=Network(9779f23d-dacb-404a-b0a7-673eb9988685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf187fe-1d')
Dec 05 14:00:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Deleting instance files /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768_del
Dec 05 14:00:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Deletion of /opt/stack/data/nova/instances/64b8a85a-9a06-4f5d-ace7-0d0b331c0768_del complete
Dec 05 14:00:53 user nova-compute[75233]: INFO nova.compute.manager [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 05 14:00:53 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:00:53 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:00:53 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:00:53 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:00:53 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Took 0.88 seconds to deallocate network for instance.
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:54 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Deleted allocations for instance 64b8a85a-9a06-4f5d-ace7-0d0b331c0768
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-8767dfa8-0585-4ae1-93b8-1e03d8862693 tempest-AttachVolumeNegativeTest-525245035 tempest-AttachVolumeNegativeTest-525245035-project-member] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] Acquiring lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] Lock "64b8a85a-9a06-4f5d-ace7-0d0b331c0768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] No waiting events found dispatching network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:00:54 user nova-compute[75233]: WARNING nova.compute.manager [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received unexpected event network-vif-plugged-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 for instance with vm_state deleted and task_state None.
Dec 05 14:00:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-24cf1dc1-87f5-4f35-968c-309f2bab6771 req-0ce7c04c-0b70-4a6a-8e5f-de6c69a20689 service nova] [instance: 64b8a85a-9a06-4f5d-ace7-0d0b331c0768] Received event network-vif-deleted-6cf187fe-1d84-43d1-95ec-d07db6ca0b77 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:00:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:00:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:00 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:01:00 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8282MB free_disk=24.971439361572266GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:01:00 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:01:01 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:01:01 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:01:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:01:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:01:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:01:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:01:12 user nova-compute[75233]: INFO nova.compute.claims [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Claim successful on node user
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:01:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:01:12 user nova-compute[75233]: INFO nova.virt.block_device [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Booting with volume-backed-image b4dfffde-9cf2-443d-89c3-b4ad40b1f06e at /dev/vda
Dec 05 14:01:12 user nova-compute[75233]: DEBUG nova.policy [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df61cbca359144e4a0c9ce81b51ebcee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd04a994cbca48239afebd5080f31725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:01:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Successfully created port: 9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Successfully updated port: 9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-changed-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Refreshing instance network info cache due to event network-changed-9dac7c05-94b6-42d9-80d2-4aea62f417c2. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] Acquiring lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:01:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance network_info: |[{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] Acquired lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Refreshing network info cache for port 9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updated VIF entry in instance network info cache for port 9dac7c05-94b6-42d9-80d2-4aea62f417c2. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:01:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f831cee0-296d-4d27-af9f-9efda7d94323 req-a3f22946-fd3e-4904-97c0-54d03dce77e7 service nova] Releasing lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:01:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:24 user nova-compute[75233]: INFO nova.compute.manager [None req-69c927e9-9121-48b8-b9ba-1554a23d2ea4 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Get console output
Dec 05 14:01:24 user nova-compute[75233]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 05 14:01:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG os_brick.utils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[10debec5-2e88-42da-ae82-ad7e40b42eff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1506b7-2b64-4a4f-a589-28caafae1c86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6ba5a2-4453-4fb9-82f3-5d3b5720d62e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf1e9dd-d494-4986-882a-56e8b42f9d47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:01:28 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:01:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63d2a65-f281-4fee-ac62-6d39fc84b7da]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG os_brick.utils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:01:28 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating existing volume attachment record: bf7e6cc9-b938-402f-b64d-8c4489482255 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:01:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:01:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Creating image(s)
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Ensure instance console log exists: /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Start _get_guest_xml network_info=[{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d7dcc32-4c98-49c0-83de-edfb17fde4f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'serial': 'fda0c10d-dba4-4a3d-a318-5d85636a6b60'}, 'delete_on_termination': False, 'attachment_id': 'bf7e6cc9-b938-402f-b64d-8c4489482255', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:01:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:01:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:01:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:01:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:01:38 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[743bca98-c45b-4f04-a031-743d3004984d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:01:38 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a36a57-8cc7-47a6-88fe-7fb6a327c04f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60] added
Dec 05 14:01:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedbc4c3-30ff-4c33-8496-d05ec7925610]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d639a1e7-3a9b-4ab4-9a79-ac3dc0f13e18]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPTeZsYz {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPTeZsYz" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85b017-8f93-4297-8264-9ccf93ed34c9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPTeZsYz'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744311b-4d3c-499e-9e23-57123b2ddf59]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a29f45-fc70-4d5b-93b4-d0ce275fa1af]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:01:39 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:01:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:01:39 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:01:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[610eebda-9c62-44f2-a4ed-43eb7101a04f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260]
Dec 05 14:01:39 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260] successful.
Dec 05 14:01:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[26415829-bfe5-4175-8437-e332068b2f9c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[25573d0f-5b86-4b48-bb08-6f97f7becba4]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:01:39 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:01:39 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:01:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:01:39 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:01:39 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:01:39 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fbb150-0907-4fbe-acb3-c2e1f1651bec]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:01:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23462623530666339', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462623530666339', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1201397284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1201397284',id=38,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-s03pug3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:01:12Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=5d7dcc32-4c98-49c0-83de-edfb17fde4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:01:40 user nova-compute[75233]:   <uuid>5d7dcc32-4c98-49c0-83de-edfb17fde4f2</uuid>
Dec 05 14:01:40 user nova-compute[75233]:   <name>instance-00000026</name>
Dec 05 14:01:40 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:01:40 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:01:40 user nova-compute[75233]:   <metadata>
Dec 05 14:01:40 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:01:40 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:01:40 user nova-compute[75233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1201397284</nova:name>
Dec 05 14:01:40 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:01:38</nova:creationTime>
Dec 05 14:01:40 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:01:40 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:01:40 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:01:40 user nova-compute[75233]:       <nova:owner>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:user uuid="df61cbca359144e4a0c9ce81b51ebcee">tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member</nova:user>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:project uuid="bd04a994cbca48239afebd5080f31725">tempest-ServerBootFromVolumeStableRescueTest-264323439</nova:project>
Dec 05 14:01:40 user nova-compute[75233]:       </nova:owner>
Dec 05 14:01:40 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:01:40 user nova-compute[75233]:       <nova:ports>
Dec 05 14:01:40 user nova-compute[75233]:         <nova:port uuid="9dac7c05-94b6-42d9-80d2-4aea62f417c2">
Dec 05 14:01:40 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 14:01:40 user nova-compute[75233]:         </nova:port>
Dec 05 14:01:40 user nova-compute[75233]:       </nova:ports>
Dec 05 14:01:40 user nova-compute[75233]:     </nova:instance>
Dec 05 14:01:40 user nova-compute[75233]:   </metadata>
Dec 05 14:01:40 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:01:40 user nova-compute[75233]:     <system>
Dec 05 14:01:40 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:01:40 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:01:40 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:01:40 user nova-compute[75233]:       <entry name="serial">5d7dcc32-4c98-49c0-83de-edfb17fde4f2</entry>
Dec 05 14:01:40 user nova-compute[75233]:       <entry name="uuid">5d7dcc32-4c98-49c0-83de-edfb17fde4f2</entry>
Dec 05 14:01:40 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:01:40 user nova-compute[75233]:     </system>
Dec 05 14:01:40 user nova-compute[75233]:   </sysinfo>
Dec 05 14:01:40 user nova-compute[75233]:   <os>
Dec 05 14:01:40 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:01:40 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:01:40 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:01:40 user nova-compute[75233]:   </os>
Dec 05 14:01:40 user nova-compute[75233]:   <features>
Dec 05 14:01:40 user nova-compute[75233]:     <acpi/>
Dec 05 14:01:40 user nova-compute[75233]:     <apic/>
Dec 05 14:01:40 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:01:40 user nova-compute[75233]:   </features>
Dec 05 14:01:40 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:01:40 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:01:40 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:01:40 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:01:40 user nova-compute[75233]:   </clock>
Dec 05 14:01:40 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:01:40 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:01:40 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:01:40 user nova-compute[75233]:   </cpu>
Dec 05 14:01:40 user nova-compute[75233]:   <devices>
Dec 05 14:01:40 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:01:40 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:01:40 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 14:01:40 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:01:40 user nova-compute[75233]:       <serial>fda0c10d-dba4-4a3d-a318-5d85636a6b60</serial>
Dec 05 14:01:40 user nova-compute[75233]:     </disk>
Dec 05 14:01:40 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:01:40 user nova-compute[75233]:       <mac address="fa:16:3e:57:08:fb"/>
Dec 05 14:01:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:01:40 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:01:40 user nova-compute[75233]:       <target dev="tap9dac7c05-94"/>
Dec 05 14:01:40 user nova-compute[75233]:     </interface>
Dec 05 14:01:40 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:01:40 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/console.log" append="off"/>
Dec 05 14:01:40 user nova-compute[75233]:     </serial>
Dec 05 14:01:40 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:01:40 user nova-compute[75233]:     <video>
Dec 05 14:01:40 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:01:40 user nova-compute[75233]:     </video>
Dec 05 14:01:40 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:01:40 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:01:40 user nova-compute[75233]:     </rng>
Dec 05 14:01:40 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:01:40 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:01:40 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:01:40 user nova-compute[75233]:     </memballoon>
Dec 05 14:01:40 user nova-compute[75233]:   </devices>
Dec 05 14:01:40 user nova-compute[75233]: </domain>
Dec 05 14:01:40 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1201397284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1201397284',id=38,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-s03pug3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:01:12Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=5d7dcc32-4c98-49c0-83de-edfb17fde4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG os_vif [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bc1f650-ebee-5fdd-8489-f0445fa89960', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dac7c05-94, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dac7c05-94, col_values=(('qos', UUID('362bad23-7027-424a-a49d-3d77271ba3f6')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dac7c05-94, col_values=(('external_ids', {'iface-id': '9dac7c05-94b6-42d9-80d2-4aea62f417c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:08:fb', 'vm-uuid': '5d7dcc32-4c98-49c0-83de-edfb17fde4f2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:40 user nova-compute[75233]: INFO os_vif [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94')
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:01:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No VIF found with MAC fa:16:3e:57:08:fb, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-0ab7ea2a-2c07-4dc3-8924-670e097aebe3 req-2e4e55b1-0b5e-43f8-aac6-dfa2512f3715 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0ab7ea2a-2c07-4dc3-8924-670e097aebe3 req-2e4e55b1-0b5e-43f8-aac6-dfa2512f3715 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0ab7ea2a-2c07-4dc3-8924-670e097aebe3 req-2e4e55b1-0b5e-43f8-aac6-dfa2512f3715 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0ab7ea2a-2c07-4dc3-8924-670e097aebe3 req-2e4e55b1-0b5e-43f8-aac6-dfa2512f3715 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-0ab7ea2a-2c07-4dc3-8924-670e097aebe3 req-2e4e55b1-0b5e-43f8-aac6-dfa2512f3715 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:01:41 user nova-compute[75233]: WARNING nova.compute.manager [req-0ab7ea2a-2c07-4dc3-8924-670e097aebe3 req-2e4e55b1-0b5e-43f8-aac6-dfa2512f3715 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state building and task_state spawning.
Dec 05 14:01:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:01:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance spawned successfully.
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:01:43 user nova-compute[75233]: INFO nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Took 5.05 seconds to spawn the instance on the hypervisor.
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-c14f037c-a555-4a34-878c-cad9cd91e7b4 req-79bf027d-45ab-4fae-92dc-56bcec89dede service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c14f037c-a555-4a34-878c-cad9cd91e7b4 req-79bf027d-45ab-4fae-92dc-56bcec89dede service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c14f037c-a555-4a34-878c-cad9cd91e7b4 req-79bf027d-45ab-4fae-92dc-56bcec89dede service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c14f037c-a555-4a34-878c-cad9cd91e7b4 req-79bf027d-45ab-4fae-92dc-56bcec89dede service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-c14f037c-a555-4a34-878c-cad9cd91e7b4 req-79bf027d-45ab-4fae-92dc-56bcec89dede service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:01:43 user nova-compute[75233]: WARNING nova.compute.manager [req-c14f037c-a555-4a34-878c-cad9cd91e7b4 req-79bf027d-45ab-4fae-92dc-56bcec89dede service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state building and task_state spawning.
Dec 05 14:01:44 user nova-compute[75233]: INFO nova.compute.manager [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Took 32.12 seconds to build instance.
Dec 05 14:01:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7cf65132-f7e6-4b2b-a03e-2d9fc8322804 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.228s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:01:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:00 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:01 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:02:01 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8228MB free_disk=24.959518432617188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:01 user nova-compute[75233]: INFO nova.compute.manager [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Terminating instance
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 05d8a032-7b26-4106-afe5-4bc5b811388a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 11fe694c-476e-465f-8b23-f8e2bffd7938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:02:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-f96775db-9311-4438-8bcc-e1db216c8b11 req-7e6a225d-83d8-433a-8b20-4c66598dae8a service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-vif-unplugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f96775db-9311-4438-8bcc-e1db216c8b11 req-7e6a225d-83d8-433a-8b20-4c66598dae8a service nova] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f96775db-9311-4438-8bcc-e1db216c8b11 req-7e6a225d-83d8-433a-8b20-4c66598dae8a service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f96775db-9311-4438-8bcc-e1db216c8b11 req-7e6a225d-83d8-433a-8b20-4c66598dae8a service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-f96775db-9311-4438-8bcc-e1db216c8b11 req-7e6a225d-83d8-433a-8b20-4c66598dae8a service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] No waiting events found dispatching network-vif-unplugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-f96775db-9311-4438-8bcc-e1db216c8b11 req-7e6a225d-83d8-433a-8b20-4c66598dae8a service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-vif-unplugged-78d559cd-9c46-470c-91cb-b3390ee96944 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:02:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Instance destroyed successfully.
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.objects.instance [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lazy-loading 'resources' on Instance uuid 05d8a032-7b26-4106-afe5-4bc5b811388a {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505085857',display_name='tempest-ServersNegativeTestJSON-server-505085857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505085857',id=30,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d6981d4b1664b71b00ba32fd7ff1425',ramdisk_id='',reservation_id='r-8dicuhux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1092330110',owner_user_name='tempest-ServersNegativeTestJSON-1092330110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:53:18Z,user_data=None,user_id='6c61839790d6421c8ce129287e6dbc0b',uuid=05d8a032-7b26-4106-afe5-4bc5b811388a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converting VIF {"id": "78d559cd-9c46-470c-91cb-b3390ee96944", "address": "fa:16:3e:b0:09:fe", "network": {"id": "720b3f02-04c8-402d-b761-a143472e086e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-423716618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d6981d4b1664b71b00ba32fd7ff1425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d559cd-9c", "ovs_interfaceid": "78d559cd-9c46-470c-91cb-b3390ee96944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG os_vif [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78d559cd-9c, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ec3542e-7d7b-4a7c-a7a0-332558daf3d2) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:02 user nova-compute[75233]: INFO os_vif [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:09:fe,bridge_name='br-int',has_traffic_filtering=True,id=78d559cd-9c46-470c-91cb-b3390ee96944,network=Network(720b3f02-04c8-402d-b761-a143472e086e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d559cd-9c')
Dec 05 14:02:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Deleting instance files /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a_del
Dec 05 14:02:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Deletion of /opt/stack/data/nova/instances/05d8a032-7b26-4106-afe5-4bc5b811388a_del complete
Dec 05 14:02:02 user nova-compute[75233]: INFO nova.compute.manager [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 05 14:02:02 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:02:02 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:02:03 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:02:03 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Took 0.79 seconds to deallocate network for instance.
Dec 05 14:02:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-deb56b29-3511-4b93-86a3-1c2491421cd3 req-2a1a206c-f5e9-4aee-99e9-e9f5a896a258 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-vif-deleted-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:03 user nova-compute[75233]: INFO nova.compute.manager [req-deb56b29-3511-4b93-86a3-1c2491421cd3 req-2a1a206c-f5e9-4aee-99e9-e9f5a896a258 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Neutron deleted interface 78d559cd-9c46-470c-91cb-b3390ee96944; detaching it from the instance and deleting it from the info cache
Dec 05 14:02:03 user nova-compute[75233]: DEBUG nova.network.neutron [req-deb56b29-3511-4b93-86a3-1c2491421cd3 req-2a1a206c-f5e9-4aee-99e9-e9f5a896a258 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:02:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-deb56b29-3511-4b93-86a3-1c2491421cd3 req-2a1a206c-f5e9-4aee-99e9-e9f5a896a258 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Detach interface failed, port_id=78d559cd-9c46-470c-91cb-b3390ee96944, reason: Instance 05d8a032-7b26-4106-afe5-4bc5b811388a could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:02:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:04 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Deleted allocations for instance 05d8a032-7b26-4106-afe5-4bc5b811388a
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-36abd8ea-50a0-4e2a-92b2-cf1645d036ae tempest-ServersNegativeTestJSON-1092330110 tempest-ServersNegativeTestJSON-1092330110-project-member] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-b81f3642-30e7-4c00-9586-94c108e4685f req-d4e7559f-022d-4ec7-ab5a-466c8db463a7 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received event network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b81f3642-30e7-4c00-9586-94c108e4685f req-d4e7559f-022d-4ec7-ab5a-466c8db463a7 service nova] Acquiring lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b81f3642-30e7-4c00-9586-94c108e4685f req-d4e7559f-022d-4ec7-ab5a-466c8db463a7 service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b81f3642-30e7-4c00-9586-94c108e4685f req-d4e7559f-022d-4ec7-ab5a-466c8db463a7 service nova] Lock "05d8a032-7b26-4106-afe5-4bc5b811388a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-b81f3642-30e7-4c00-9586-94c108e4685f req-d4e7559f-022d-4ec7-ab5a-466c8db463a7 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] No waiting events found dispatching network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:04 user nova-compute[75233]: WARNING nova.compute.manager [req-b81f3642-30e7-4c00-9586-94c108e4685f req-d4e7559f-022d-4ec7-ab5a-466c8db463a7 service nova] [instance: 05d8a032-7b26-4106-afe5-4bc5b811388a] Received unexpected event network-vif-plugged-78d559cd-9c46-470c-91cb-b3390ee96944 for instance with vm_state deleted and task_state None.
Dec 05 14:02:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:02:11 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid bda94a77-e19a-4ea0-88ca-19c86689cd0b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:02:12 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [{"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:02:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-bda94a77-e19a-4ea0-88ca-19c86689cd0b" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:02:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:02:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:25 user nova-compute[75233]: INFO nova.compute.manager [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Terminating instance
Dec 05 14:02:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-d42b4cfa-fe22-4fd6-8fb0-61276844c71e req-c47d3774-5921-44a4-9fa7-c79032a6ed93 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d42b4cfa-fe22-4fd6-8fb0-61276844c71e req-c47d3774-5921-44a4-9fa7-c79032a6ed93 service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d42b4cfa-fe22-4fd6-8fb0-61276844c71e req-c47d3774-5921-44a4-9fa7-c79032a6ed93 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d42b4cfa-fe22-4fd6-8fb0-61276844c71e req-c47d3774-5921-44a4-9fa7-c79032a6ed93 service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-d42b4cfa-fe22-4fd6-8fb0-61276844c71e req-c47d3774-5921-44a4-9fa7-c79032a6ed93 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-d42b4cfa-fe22-4fd6-8fb0-61276844c71e req-c47d3774-5921-44a4-9fa7-c79032a6ed93 service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Instance destroyed successfully.
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'resources' on Instance uuid 11fe694c-476e-465f-8b23-f8e2bffd7938 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:55:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-911532962',display_name='tempest-ServerActionsTestOtherA-server-911532962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-911532962',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:58:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-l7i7d47w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=11fe694c-476e-465f-8b23-f8e2bffd7938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "address": "fa:16:3e:71:49:1a", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021bf74e-59", "ovs_interfaceid": "021bf74e-59c6-4e5b-92f0-5c75b594384e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_vif [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap021bf74e-59, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd0c1d32-8a6e-4773-ad12-c95c665ae021) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:26 user nova-compute[75233]: INFO os_vif [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:49:1a,bridge_name='br-int',has_traffic_filtering=True,id=021bf74e-59c6-4e5b-92f0-5c75b594384e,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021bf74e-59')
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ampsTHiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:02:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7717334f-731f-4acf-b2ed-a8cb78455fe5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:02:26 user nova-compute[75233]: No targets found.
Dec 05 14:02:26 user nova-compute[75233]: iSNS:
Dec 05 14:02:26 user nova-compute[75233]: No targets found.
Dec 05 14:02:26 user nova-compute[75233]: STATIC:
Dec 05 14:02:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 14:02:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:02:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:02:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60
Dec 05 14:02:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:02:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:02:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4
Dec 05 14:02:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:02:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:02:26 user nova-compute[75233]: FIRMWARE:
Dec 05 14:02:26 user nova-compute[75233]: No targets found.
Dec 05 14:02:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:02:26 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:02:26 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1bccb2-4bd1-4595-84db-b94353779bc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb40c38-4400-4736-af00-f1523e3ba60b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:02:26 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:02:26 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:02:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:02:26 user nova-compute[75233]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 (non-flash)
Dec 05 14:02:26 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:02:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582c3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[046e4330-5321-4768-8af2-a5e2145dc2ea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1211ad4-734e-44fc-9f02-64be8113a41f]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6541492-facf-48ba-8a28-8fdce4f7e560]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feef9a0-87d6-4f07-85e2-728f29dca256]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e99c9d2-c24f-4b18-9e31-1962123a4524]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.170s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[513bc158-b4d5-4552-a33c-b5e9a68fae7c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260]
Dec 05 14:02:26 user nova-compute[75233]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4, portal: 172.16.0.220,3260] successful.
Dec 05 14:02:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8c7f28-31bb-4a30-91a5-36157799bcf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9672057-f3fb-4479-83aa-f8770625f365]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] <== disconnect_volume: return (453ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:02:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Deleting instance files /opt/stack/data/nova/instances/11fe694c-476e-465f-8b23-f8e2bffd7938_del
Dec 05 14:02:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Deletion of /opt/stack/data/nova/instances/11fe694c-476e-465f-8b23-f8e2bffd7938_del complete
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:26 user nova-compute[75233]: INFO nova.compute.manager [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Took 1.41 seconds to destroy the instance on the hypervisor.
Dec 05 14:02:26 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:02:26 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:02:27 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Took 0.84 seconds to deallocate network for instance.
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:27 user nova-compute[75233]: WARNING nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state deleting.
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:27 user nova-compute[75233]: WARNING nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state deleting.
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:27 user nova-compute[75233]: WARNING nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state deleting.
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-unplugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Acquiring lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] No waiting events found dispatching network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:02:27 user nova-compute[75233]: WARNING nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received unexpected event network-vif-plugged-021bf74e-59c6-4e5b-92f0-5c75b594384e for instance with vm_state active and task_state deleting.
Dec 05 14:02:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-02bba9f4-20c3-4f99-89b5-d915580b8f41 req-6b0ea6b4-c99c-46d9-9c15-a7586832c50a service nova] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Received event network-vif-deleted-021bf74e-59c6-4e5b-92f0-5c75b594384e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:02:28 user nova-compute[75233]: INFO nova.compute.manager [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Took 0.95 seconds to detach 1 volumes for instance.
Dec 05 14:02:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: 11fe694c-476e-465f-8b23-f8e2bffd7938] Deleting volume: 9e8c7f28-31bb-4a30-91a5-36157799bcf4 {{(pid=75233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 14:02:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:02:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:02:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:02:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:02:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:28 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Deleted allocations for instance 11fe694c-476e-465f-8b23-f8e2bffd7938
Dec 05 14:02:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c9afa0d5-4e49-4a88-9d8b-2bb266e77f1c tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "11fe694c-476e-465f-8b23-f8e2bffd7938" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.709s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:02:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:02:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:02:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:02:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:02:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:02:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:02:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:02:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:02:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:02:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:02:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:02 user nova-compute[75233]: INFO nova.compute.manager [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Rescuing
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:03:02 user nova-compute[75233]: DEBUG nova.network.neutron [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:03 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:03 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=24.983985900878906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bda94a77-e19a-4ea0-88ca-19c86689cd0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:03:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-441fdc4b-b8a1-4baa-b209-b42079846682 req-70452f1a-d273-40d3-bdcf-4cdebc05d0ef service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-441fdc4b-b8a1-4baa-b209-b42079846682 req-70452f1a-d273-40d3-bdcf-4cdebc05d0ef service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-441fdc4b-b8a1-4baa-b209-b42079846682 req-70452f1a-d273-40d3-bdcf-4cdebc05d0ef service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-441fdc4b-b8a1-4baa-b209-b42079846682 req-70452f1a-d273-40d3-bdcf-4cdebc05d0ef service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-441fdc4b-b8a1-4baa-b209-b42079846682 req-70452f1a-d273-40d3-bdcf-4cdebc05d0ef service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:04 user nova-compute[75233]: WARNING nova.compute.manager [req-441fdc4b-b8a1-4baa-b209-b42079846682 req-70452f1a-d273-40d3-bdcf-4cdebc05d0ef service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state active and task_state rescuing.
Dec 05 14:03:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance destroyed successfully.
Dec 05 14:03:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Attempting a stable device rescue
Dec 05 14:03:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75233) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance directory exists: not creating {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 05 14:03:04 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Creating image(s)
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "/opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "f8e28a4357370f3df1e221cb294e16b243da8592" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "f8e28a4357370f3df1e221cb294e16b243da8592" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG nova.virt.images [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] fed7978f-b5e1-4d2b-b2f8-696fd364f550 was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.part /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-4a226031-ebd8-409a-9ed0-37c508772d4f req-fe6f5975-b5a4-4e68-8ee0-e8b2d75fa493 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4a226031-ebd8-409a-9ed0-37c508772d4f req-fe6f5975-b5a4-4e68-8ee0-e8b2d75fa493 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4a226031-ebd8-409a-9ed0-37c508772d4f req-fe6f5975-b5a4-4e68-8ee0-e8b2d75fa493 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4a226031-ebd8-409a-9ed0-37c508772d4f req-fe6f5975-b5a4-4e68-8ee0-e8b2d75fa493 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-4a226031-ebd8-409a-9ed0-37c508772d4f req-fe6f5975-b5a4-4e68-8ee0-e8b2d75fa493 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:06 user nova-compute[75233]: WARNING nova.compute.manager [req-4a226031-ebd8-409a-9ed0-37c508772d4f req-fe6f5975-b5a4-4e68-8ee0-e8b2d75fa493 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state active and task_state rescuing.
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.part /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.converted" returned: 0 in 0.513s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "f8e28a4357370f3df1e221cb294e16b243da8592" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.038s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "f8e28a4357370f3df1e221cb294e16b243da8592" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "f8e28a4357370f3df1e221cb294e16b243da8592" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592 --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592,backing_fmt=raw /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592,backing_fmt=raw /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue" returned: 0 in 0.048s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "f8e28a4357370f3df1e221cb294e16b243da8592" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'migration_context' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<5d7dcc32-4c98-49c0-83de-edfb17fde4f2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Start _get_guest_xml network_info=[{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "vif_mac": "fa:16:3e:57:08:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fed7978f-b5e1-4d2b-b2f8-696fd364f550', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5d7dcc32-4c98-49c0-83de-edfb17fde4f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'serial': 'fda0c10d-dba4-4a3d-a318-5d85636a6b60'}, 'delete_on_termination': False, 'attachment_id': 'bf7e6cc9-b938-402f-b64d-8c4489482255', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'resources' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<5d7dcc32-4c98-49c0-83de-edfb17fde4f2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<5d7dcc32-4c98-49c0-83de-edfb17fde4f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:03:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<5d7dcc32-4c98-49c0-83de-edfb17fde4f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:03:07 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:03:07 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:03:07 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e9deac-1b8f-4b32-a79f-ea309d9468c8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UPTeZsYz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 14:03:07 user nova-compute[75233]: node.name = iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60
Dec 05 14:03:07 user nova-compute[75233]: node.tpgt = -1
Dec 05 14:03:07 user nova-compute[75233]: node.startup = automatic
Dec 05 14:03:07 user nova-compute[75233]: node.leading_login = No
Dec 05 14:03:07 user nova-compute[75233]: iface.iscsi_ifacename = default
Dec 05 14:03:07 user nova-compute[75233]: iface.net_ifacename = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.ipaddress = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.prefix_len = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.hwaddress = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.transport_name = tcp
Dec 05 14:03:07 user nova-compute[75233]: iface.initiatorname = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.vlan_id = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.vlan_priority = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.vlan_state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.iface_num = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.mtu = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.port = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.bootproto = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.subnet_mask = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.gateway = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_alt_client_id = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_dns = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_learn_iqn = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_vendor_id_state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_vendor_id = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.dhcp_slp_da = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.fragmentation = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.gratuitous_arp = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.incoming_forwarding = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.tos_state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.tos = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.ttl = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.delayed_ack = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.tcp_nagle = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.tcp_wsf_state = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.tcp_wsf = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.tcp_timer_scale = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.tcp_timestamp = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.redirect = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.def_task_mgmt_timeout = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.header_digest = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.data_digest = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.immediate_data = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.initial_r2t = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.data_seq_inorder = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.data_pdu_inorder = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.erl = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.max_receive_data_len = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.first_burst_len = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.max_outstanding_r2t = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.max_burst_len = 0
Dec 05 14:03:07 user nova-compute[75233]: iface.chap_auth = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.bidi_chap = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.strict_login_compliance = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.discovery_auth = <empty>
Dec 05 14:03:07 user nova-compute[75233]: iface.discovery_logout = <empty>
Dec 05 14:03:07 user nova-compute[75233]: node.discovery_address = <empty>
Dec 05 14:03:07 user nova-compute[75233]: node.discovery_port = 0
Dec 05 14:03:07 user nova-compute[75233]: node.discovery_type = static
Dec 05 14:03:07 user nova-compute[75233]: node.session.initial_cmdsn = 0
Dec 05 14:03:07 user nova-compute[75233]: node.session.initial_login_retry_max = 8
Dec 05 14:03:07 user nova-compute[75233]: node.session.xmit_thread_priority = -20
Dec 05 14:03:07 user nova-compute[75233]: node.session.cmds_max = 128
Dec 05 14:03:07 user nova-compute[75233]: node.session.queue_depth = 32
Dec 05 14:03:07 user nova-compute[75233]: node.session.nr_sessions = 1
Dec 05 14:03:07 user nova-compute[75233]: node.session.auth.authmethod = CHAP
Dec 05 14:03:07 user nova-compute[75233]: node.session.auth.username = UPTeZsYz
Dec 05 14:03:07 user nova-compute[75233]: node.session.auth.password = ***
Dec 05 14:03:07 user nova-compute[75233]: node.session.auth.username_in = <empty>
Dec 05 14:03:07 user nova-compute[75233]: node.session.auth.password_in = <empty>
Dec 05 14:03:07 user nova-compute[75233]: node.session.auth.chap_algs = MD5
Dec 05 14:03:07 user nova-compute[75233]: node.session.timeo.replacement_timeout = 120
Dec 05 14:03:07 user nova-compute[75233]: node.session.err_timeo.abort_timeout = 15
Dec 05 14:03:07 user nova-compute[75233]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 14:03:07 user nova-compute[75233]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 14:03:07 user nova-compute[75233]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.FastAbort = Yes
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.InitialR2T = No
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.ImmediateData = Yes
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.MaxConnections = 1
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 14:03:07 user nova-compute[75233]: node.session.iscsi.ERL = 0
Dec 05 14:03:07 user nova-compute[75233]: node.session.scan = manual
Dec 05 14:03:07 user nova-compute[75233]: node.session.reopen_max = 0
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].address = 172.16.0.220
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].port = 3260
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].startup = manual
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].tcp.window_size = 524288
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].tcp.type_of_service = 0
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].timeo.logout_timeout = 15
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].timeo.login_timeout = 15
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].timeo.auth_timeout = 45
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].iscsi.DataDigest = None
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].iscsi.IFMarker = No
Dec 05 14:03:07 user nova-compute[75233]: node.conn[0].iscsi.OFMarker = No
Dec 05 14:03:07 user nova-compute[75233]: # END RECORD
Dec 05 14:03:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5b632-5831-4f35-a662-2d74af70c9b7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a91b7f4-7c33-4eeb-bb1a-198045b1e9a3]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPTeZsYz {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPTeZsYz" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0ad19a-7a15-4c2b-a92e-5b3b974f83a1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPTeZsYz'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[791cbc26-061e-4b6b-b767-91655bb197d8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d67ed-ca74-4888-8140-a123806daccd]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:03:07 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:03:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:03:07 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:03:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] HCTL ('33', '0', '0', 0) found on session 50 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100815f-5dcc-4c1e-be22-0d3e6099bf11]: (4, ('0 0 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Searching for a device in session 50 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23462623530666339', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462623530666339', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1201397284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1201397284',id=38,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:01:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-s03pug3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:01:44Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=5d7dcc32-4c98-49c0-83de-edfb17fde4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "vif_mac": "fa:16:3e:57:08:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "vif_mac": "fa:16:3e:57:08:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.instance [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.objects.base [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Object Instance<5d7dcc32-4c98-49c0-83de-edfb17fde4f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:03:07 user nova-compute[75233]:   <uuid>5d7dcc32-4c98-49c0-83de-edfb17fde4f2</uuid>
Dec 05 14:03:07 user nova-compute[75233]:   <name>instance-00000026</name>
Dec 05 14:03:07 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:03:07 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:03:07 user nova-compute[75233]:   <metadata>
Dec 05 14:03:07 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:03:07 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:03:07 user nova-compute[75233]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1201397284</nova:name>
Dec 05 14:03:07 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:03:07</nova:creationTime>
Dec 05 14:03:07 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:03:07 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:03:07 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:03:07 user nova-compute[75233]:       <nova:owner>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:user uuid="df61cbca359144e4a0c9ce81b51ebcee">tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member</nova:user>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:project uuid="bd04a994cbca48239afebd5080f31725">tempest-ServerBootFromVolumeStableRescueTest-264323439</nova:project>
Dec 05 14:03:07 user nova-compute[75233]:       </nova:owner>
Dec 05 14:03:07 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:03:07 user nova-compute[75233]:       <nova:ports>
Dec 05 14:03:07 user nova-compute[75233]:         <nova:port uuid="9dac7c05-94b6-42d9-80d2-4aea62f417c2">
Dec 05 14:03:07 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 14:03:07 user nova-compute[75233]:         </nova:port>
Dec 05 14:03:07 user nova-compute[75233]:       </nova:ports>
Dec 05 14:03:07 user nova-compute[75233]:     </nova:instance>
Dec 05 14:03:07 user nova-compute[75233]:   </metadata>
Dec 05 14:03:07 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:03:07 user nova-compute[75233]:     <system>
Dec 05 14:03:07 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:03:07 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:03:07 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:03:07 user nova-compute[75233]:       <entry name="serial">5d7dcc32-4c98-49c0-83de-edfb17fde4f2</entry>
Dec 05 14:03:07 user nova-compute[75233]:       <entry name="uuid">5d7dcc32-4c98-49c0-83de-edfb17fde4f2</entry>
Dec 05 14:03:07 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:03:07 user nova-compute[75233]:     </system>
Dec 05 14:03:07 user nova-compute[75233]:   </sysinfo>
Dec 05 14:03:07 user nova-compute[75233]:   <os>
Dec 05 14:03:07 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:03:07 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:03:07 user nova-compute[75233]:   </os>
Dec 05 14:03:07 user nova-compute[75233]:   <features>
Dec 05 14:03:07 user nova-compute[75233]:     <acpi/>
Dec 05 14:03:07 user nova-compute[75233]:     <apic/>
Dec 05 14:03:07 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:03:07 user nova-compute[75233]:   </features>
Dec 05 14:03:07 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:03:07 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:03:07 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:03:07 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:03:07 user nova-compute[75233]:   </clock>
Dec 05 14:03:07 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:03:07 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:03:07 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:03:07 user nova-compute[75233]:   </cpu>
Dec 05 14:03:07 user nova-compute[75233]:   <devices>
Dec 05 14:03:07 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:03:07 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:03:07 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 14:03:07 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:03:07 user nova-compute[75233]:       <serial>fda0c10d-dba4-4a3d-a318-5d85636a6b60</serial>
Dec 05 14:03:07 user nova-compute[75233]:     </disk>
Dec 05 14:03:07 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:03:07 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:03:07 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue"/>
Dec 05 14:03:07 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 14:03:07 user nova-compute[75233]:       <boot order="1"/>
Dec 05 14:03:07 user nova-compute[75233]:     </disk>
Dec 05 14:03:07 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:03:07 user nova-compute[75233]:       <mac address="fa:16:3e:57:08:fb"/>
Dec 05 14:03:07 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:03:07 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:03:07 user nova-compute[75233]:       <target dev="tap9dac7c05-94"/>
Dec 05 14:03:07 user nova-compute[75233]:     </interface>
Dec 05 14:03:07 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:03:07 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/console.log" append="off"/>
Dec 05 14:03:07 user nova-compute[75233]:     </serial>
Dec 05 14:03:07 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:03:07 user nova-compute[75233]:     <video>
Dec 05 14:03:07 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:03:07 user nova-compute[75233]:     </video>
Dec 05 14:03:07 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:03:07 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:03:07 user nova-compute[75233]:     </rng>
Dec 05 14:03:07 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:03:07 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:03:07 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:03:07 user nova-compute[75233]:     </memballoon>
Dec 05 14:03:07 user nova-compute[75233]:   </devices>
Dec 05 14:03:07 user nova-compute[75233]: </domain>
Dec 05 14:03:07 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:03:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance destroyed successfully.
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:03:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] No VIF found with MAC fa:16:3e:57:08:fb, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:03:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-69b0ee5f-c3c7-4e2d-9c2f-5669032ba3c8 req-43a03eb1-676d-440d-b58e-140b6db61275 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69b0ee5f-c3c7-4e2d-9c2f-5669032ba3c8 req-43a03eb1-676d-440d-b58e-140b6db61275 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69b0ee5f-c3c7-4e2d-9c2f-5669032ba3c8 req-43a03eb1-676d-440d-b58e-140b6db61275 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-69b0ee5f-c3c7-4e2d-9c2f-5669032ba3c8 req-43a03eb1-676d-440d-b58e-140b6db61275 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-69b0ee5f-c3c7-4e2d-9c2f-5669032ba3c8 req-43a03eb1-676d-440d-b58e-140b6db61275 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:09 user nova-compute[75233]: WARNING nova.compute.manager [req-69b0ee5f-c3c7-4e2d-9c2f-5669032ba3c8 req-43a03eb1-676d-440d-b58e-140b6db61275 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state active and task_state rescuing.
Dec 05 14:03:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG nova.compute.manager [None req-01b767e9-c54a-45df-b8e3-c94414d8aec0 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-445594c3-9026-4855-a5a4-a7b4da5fba44 req-d9f99466-b6a7-4a28-b1ef-ae83a5fcd2a4 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-445594c3-9026-4855-a5a4-a7b4da5fba44 req-d9f99466-b6a7-4a28-b1ef-ae83a5fcd2a4 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-445594c3-9026-4855-a5a4-a7b4da5fba44 req-d9f99466-b6a7-4a28-b1ef-ae83a5fcd2a4 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-445594c3-9026-4855-a5a4-a7b4da5fba44 req-d9f99466-b6a7-4a28-b1ef-ae83a5fcd2a4 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-445594c3-9026-4855-a5a4-a7b4da5fba44 req-d9f99466-b6a7-4a28-b1ef-ae83a5fcd2a4 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:11 user nova-compute[75233]: WARNING nova.compute.manager [req-445594c3-9026-4855-a5a4-a7b4da5fba44 req-d9f99466-b6a7-4a28-b1ef-ae83a5fcd2a4 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state active and task_state rescuing.
Dec 05 14:03:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:03:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:03:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:03:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:03:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:03:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:03:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:20 user nova-compute[75233]: INFO nova.compute.manager [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Terminating instance
Dec 05 14:03:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-a8137a2f-c443-4d24-9901-a2088e550816 req-6303e0ba-61e5-46be-90a9-771976792dcf service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-vif-unplugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a8137a2f-c443-4d24-9901-a2088e550816 req-6303e0ba-61e5-46be-90a9-771976792dcf service nova] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a8137a2f-c443-4d24-9901-a2088e550816 req-6303e0ba-61e5-46be-90a9-771976792dcf service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a8137a2f-c443-4d24-9901-a2088e550816 req-6303e0ba-61e5-46be-90a9-771976792dcf service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-a8137a2f-c443-4d24-9901-a2088e550816 req-6303e0ba-61e5-46be-90a9-771976792dcf service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] No waiting events found dispatching network-vif-unplugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-a8137a2f-c443-4d24-9901-a2088e550816 req-6303e0ba-61e5-46be-90a9-771976792dcf service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-vif-unplugged-5d515d32-8096-4b30-b4f7-caee81103ded for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:03:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Instance destroyed successfully.
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lazy-loading 'resources' on Instance uuid bda94a77-e19a-4ea0-88ca-19c86689cd0b {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:44:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-33407165',display_name='tempest-ServerActionsTestOtherA-server-33407165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-33407165',id=17,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXg+M8CtfOgOCvBTqAoriJfWo5/KhjKsgJRipdcQm8tQvX5qsTfucW7BhlZPq9SMd5rKlTbfNpuBIs37UHzWIHaKwe6ynIEyISQozi+u81JPbX6ss2CfjOuxKtGfdMJmA==',key_name='tempest-keypair-232299870',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:44:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405f4ac4b28d405fb6f71f29c6557517',ramdisk_id='',reservation_id='r-lg5biu8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-875899137',owner_user_name='tempest-ServerActionsTestOtherA-875899137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:44:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5414614ea59f4b26938bf55a492e5ddd',uuid=bda94a77-e19a-4ea0-88ca-19c86689cd0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converting VIF {"id": "5d515d32-8096-4b30-b4f7-caee81103ded", "address": "fa:16:3e:f7:cb:7b", "network": {"id": "7777106d-399e-4b21-a211-af1134d15c9a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-881897716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405f4ac4b28d405fb6f71f29c6557517", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d515d32-80", "ovs_interfaceid": "5d515d32-8096-4b30-b4f7-caee81103ded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG os_vif [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d515d32-80, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9c98bea-f4a6-4dd9-b550-a72b49bd284a) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:21 user nova-compute[75233]: INFO os_vif [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=5d515d32-8096-4b30-b4f7-caee81103ded,network=Network(7777106d-399e-4b21-a211-af1134d15c9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d515d32-80')
Dec 05 14:03:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Deleting instance files /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b_del
Dec 05 14:03:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Deletion of /opt/stack/data/nova/instances/bda94a77-e19a-4ea0-88ca-19c86689cd0b_del complete
Dec 05 14:03:21 user nova-compute[75233]: INFO nova.compute.manager [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 05 14:03:21 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:21 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Took 0.51 seconds to deallocate network for instance.
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.compute.manager [req-ad3290f9-e417-4a73-af55-dbb2a2580f12 req-3e89d00d-a943-4c75-82d7-43ddd7ebd639 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-vif-deleted-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:03:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:03:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:22 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Deleted allocations for instance bda94a77-e19a-4ea0-88ca-19c86689cd0b
Dec 05 14:03:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fa4906b7-28b8-4729-a6f6-b8c9af90f598 tempest-ServerActionsTestOtherA-875899137 tempest-ServerActionsTestOtherA-875899137-project-member] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-58c80b78-81c9-4fd5-98e2-7fabc2ea217c req-ac4adb5a-5283-4262-aba0-e96eb704a793 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received event network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-58c80b78-81c9-4fd5-98e2-7fabc2ea217c req-ac4adb5a-5283-4262-aba0-e96eb704a793 service nova] Acquiring lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-58c80b78-81c9-4fd5-98e2-7fabc2ea217c req-ac4adb5a-5283-4262-aba0-e96eb704a793 service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-58c80b78-81c9-4fd5-98e2-7fabc2ea217c req-ac4adb5a-5283-4262-aba0-e96eb704a793 service nova] Lock "bda94a77-e19a-4ea0-88ca-19c86689cd0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-58c80b78-81c9-4fd5-98e2-7fabc2ea217c req-ac4adb5a-5283-4262-aba0-e96eb704a793 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] No waiting events found dispatching network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:22 user nova-compute[75233]: WARNING nova.compute.manager [req-58c80b78-81c9-4fd5-98e2-7fabc2ea217c req-ac4adb5a-5283-4262-aba0-e96eb704a793 service nova] [instance: bda94a77-e19a-4ea0-88ca-19c86689cd0b] Received unexpected event network-vif-plugged-5d515d32-8096-4b30-b4f7-caee81103ded for instance with vm_state deleted and task_state None.
Dec 05 14:03:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:03:36 user nova-compute[75233]: INFO nova.compute.claims [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Claim successful on node user
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:03:36 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:03:37 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:03:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG nova.policy [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1250912fa96345cc8b33124bc57e5a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fec6162ff24a32872749d6da8cba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:03:37 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Creating image(s)
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "/opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "/opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "/opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk 1073741824" returned: 0 in 0.052s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Successfully created port: e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:03:37 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Cannot resize image /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Ensure instance console log exists: /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Successfully updated port: e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquired lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.compute.manager [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-changed-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.compute.manager [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Refreshing instance network info cache due to event network-changed-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] Acquiring lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:03:38 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating instance_info_cache with network_info: [{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Releasing lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Instance network_info: |[{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] Acquired lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Refreshing network info cache for port e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Start _get_guest_xml network_info=[{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:03:39 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:39 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1791237440',display_name='tempest-TestStampPattern-server-1791237440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1791237440',id=39,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIedrrr5CE8wjPd1SkAUTBltBGqS1dEEAtKuYjsNtuqZmT4zwIJLInTE1TYClnheTxTqpcj8MCv2abVGlc40j1ekh9WoFXKSYiBc/BClcwOcdjLtjTZMB8WsYkVzRpRPg==',key_name='tempest-TestStampPattern-1706655752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08fec6162ff24a32872749d6da8cba62',ramdisk_id='',reservation_id='r-vbm2iipv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1121995077',owner_user_name='tempest-TestStampPattern-1121995077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:03:37Z,user_data=None,user_id='1250912fa96345cc8b33124bc57e5a66',uuid=46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converting VIF {"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'pci_devices' on Instance uuid 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:03:39 user nova-compute[75233]:   <uuid>46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9</uuid>
Dec 05 14:03:39 user nova-compute[75233]:   <name>instance-00000027</name>
Dec 05 14:03:39 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:03:39 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:03:39 user nova-compute[75233]:   <metadata>
Dec 05 14:03:39 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:03:39 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:03:39 user nova-compute[75233]:       <nova:name>tempest-TestStampPattern-server-1791237440</nova:name>
Dec 05 14:03:39 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:03:39</nova:creationTime>
Dec 05 14:03:39 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:03:39 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:03:39 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:03:39 user nova-compute[75233]:       <nova:owner>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:user uuid="1250912fa96345cc8b33124bc57e5a66">tempest-TestStampPattern-1121995077-project-member</nova:user>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:project uuid="08fec6162ff24a32872749d6da8cba62">tempest-TestStampPattern-1121995077</nova:project>
Dec 05 14:03:39 user nova-compute[75233]:       </nova:owner>
Dec 05 14:03:39 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:03:39 user nova-compute[75233]:       <nova:ports>
Dec 05 14:03:39 user nova-compute[75233]:         <nova:port uuid="e8e2a350-bc1c-4b64-b7f4-73bbe37679fc">
Dec 05 14:03:39 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 14:03:39 user nova-compute[75233]:         </nova:port>
Dec 05 14:03:39 user nova-compute[75233]:       </nova:ports>
Dec 05 14:03:39 user nova-compute[75233]:     </nova:instance>
Dec 05 14:03:39 user nova-compute[75233]:   </metadata>
Dec 05 14:03:39 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:03:39 user nova-compute[75233]:     <system>
Dec 05 14:03:39 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:03:39 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:03:39 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:03:39 user nova-compute[75233]:       <entry name="serial">46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9</entry>
Dec 05 14:03:39 user nova-compute[75233]:       <entry name="uuid">46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9</entry>
Dec 05 14:03:39 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:03:39 user nova-compute[75233]:     </system>
Dec 05 14:03:39 user nova-compute[75233]:   </sysinfo>
Dec 05 14:03:39 user nova-compute[75233]:   <os>
Dec 05 14:03:39 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:03:39 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:03:39 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:03:39 user nova-compute[75233]:   </os>
Dec 05 14:03:39 user nova-compute[75233]:   <features>
Dec 05 14:03:39 user nova-compute[75233]:     <acpi/>
Dec 05 14:03:39 user nova-compute[75233]:     <apic/>
Dec 05 14:03:39 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:03:39 user nova-compute[75233]:   </features>
Dec 05 14:03:39 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:03:39 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:03:39 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:03:39 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:03:39 user nova-compute[75233]:   </clock>
Dec 05 14:03:39 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:03:39 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:03:39 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:03:39 user nova-compute[75233]:   </cpu>
Dec 05 14:03:39 user nova-compute[75233]:   <devices>
Dec 05 14:03:39 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:03:39 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:03:39 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk"/>
Dec 05 14:03:39 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:03:39 user nova-compute[75233]:     </disk>
Dec 05 14:03:39 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:03:39 user nova-compute[75233]:       <mac address="fa:16:3e:94:cc:11"/>
Dec 05 14:03:39 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:03:39 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:03:39 user nova-compute[75233]:       <target dev="tape8e2a350-bc"/>
Dec 05 14:03:39 user nova-compute[75233]:     </interface>
Dec 05 14:03:39 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:03:39 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/console.log" append="off"/>
Dec 05 14:03:39 user nova-compute[75233]:     </serial>
Dec 05 14:03:39 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:03:39 user nova-compute[75233]:     <video>
Dec 05 14:03:39 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:03:39 user nova-compute[75233]:     </video>
Dec 05 14:03:39 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:03:39 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:03:39 user nova-compute[75233]:     </rng>
Dec 05 14:03:39 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:03:39 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:03:39 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:03:39 user nova-compute[75233]:     </memballoon>
Dec 05 14:03:39 user nova-compute[75233]:   </devices>
Dec 05 14:03:39 user nova-compute[75233]: </domain>
Dec 05 14:03:39 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1791237440',display_name='tempest-TestStampPattern-server-1791237440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1791237440',id=39,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIedrrr5CE8wjPd1SkAUTBltBGqS1dEEAtKuYjsNtuqZmT4zwIJLInTE1TYClnheTxTqpcj8MCv2abVGlc40j1ekh9WoFXKSYiBc/BClcwOcdjLtjTZMB8WsYkVzRpRPg==',key_name='tempest-TestStampPattern-1706655752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08fec6162ff24a32872749d6da8cba62',ramdisk_id='',reservation_id='r-vbm2iipv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1121995077',owner_user_name='tempest-TestStampPattern-1121995077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:03:37Z,user_data=None,user_id='1250912fa96345cc8b33124bc57e5a66',uuid=46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converting VIF {"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG os_vif [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '317b9f9d-6335-5ec5-8bc5-264b59461a8d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8e2a350-bc, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8e2a350-bc, col_values=(('qos', UUID('e66d591c-e9a7-4e89-ba10-398f925f1e13')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8e2a350-bc, col_values=(('external_ids', {'iface-id': 'e8e2a350-bc1c-4b64-b7f4-73bbe37679fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:cc:11', 'vm-uuid': '46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:39 user nova-compute[75233]: INFO os_vif [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc')
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No VIF found with MAC fa:16:3e:94:cc:11, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updated VIF entry in instance network info cache for port e8e2a350-bc1c-4b64-b7f4-73bbe37679fc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating instance_info_cache with network_info: [{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1f3f416-8947-4d0a-9f6c-f0c8c1611e97 req-6f693771-9941-4926-9232-1e00b3b5586b service nova] Releasing lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-15469b2c-dce6-4cd0-ad97-7631f9f27494 req-a21bdaa1-8efb-400d-9bd7-4b61fcecbe36 service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-15469b2c-dce6-4cd0-ad97-7631f9f27494 req-a21bdaa1-8efb-400d-9bd7-4b61fcecbe36 service nova] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-15469b2c-dce6-4cd0-ad97-7631f9f27494 req-a21bdaa1-8efb-400d-9bd7-4b61fcecbe36 service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-15469b2c-dce6-4cd0-ad97-7631f9f27494 req-a21bdaa1-8efb-400d-9bd7-4b61fcecbe36 service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-15469b2c-dce6-4cd0-ad97-7631f9f27494 req-a21bdaa1-8efb-400d-9bd7-4b61fcecbe36 service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] No waiting events found dispatching network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:40 user nova-compute[75233]: WARNING nova.compute.manager [req-15469b2c-dce6-4cd0-ad97-7631f9f27494 req-a21bdaa1-8efb-400d-9bd7-4b61fcecbe36 service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received unexpected event network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc for instance with vm_state building and task_state spawning.
Dec 05 14:03:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:03:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Instance spawned successfully.
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:03:42 user nova-compute[75233]: INFO nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Took 5.47 seconds to spawn the instance on the hypervisor.
Dec 05 14:03:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:03:42 user nova-compute[75233]: INFO nova.compute.manager [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Took 6.31 seconds to build instance.
Dec 05 14:03:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cb175fe4-3572-4e7a-b309-134c88e4aca1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.434s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-f783fd53-9a7b-44df-a542-899eb4dcab06 req-cde8d1c3-b4f9-4851-af06-375e867ca0cd service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f783fd53-9a7b-44df-a542-899eb4dcab06 req-cde8d1c3-b4f9-4851-af06-375e867ca0cd service nova] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f783fd53-9a7b-44df-a542-899eb4dcab06 req-cde8d1c3-b4f9-4851-af06-375e867ca0cd service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f783fd53-9a7b-44df-a542-899eb4dcab06 req-cde8d1c3-b4f9-4851-af06-375e867ca0cd service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-f783fd53-9a7b-44df-a542-899eb4dcab06 req-cde8d1c3-b4f9-4851-af06-375e867ca0cd service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] No waiting events found dispatching network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:03:43 user nova-compute[75233]: WARNING nova.compute.manager [req-f783fd53-9a7b-44df-a542-899eb4dcab06 req-cde8d1c3-b4f9-4851-af06-375e867ca0cd service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received unexpected event network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc for instance with vm_state active and task_state None.
Dec 05 14:03:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:03:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:55 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:03:55 user nova-compute[75233]: INFO nova.compute.claims [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Claim successful on node user
Dec 05 14:03:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:03:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.policy [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b3ba7c68eeb411a8c3cf77748216e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1d061238f6482c9a10d751ab1d2abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:03:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Creating image(s)
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "aaed931f4796586495d61fceb2105c0be77afd48" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "aaed931f4796586495d61fceb2105c0be77afd48" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.virt.images [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] 90d63c40-fc0a-4d0a-b93b-273dffffbffa was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.part /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Successfully created port: f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.part /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.converted" returned: 0 in 0.228s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "aaed931f4796586495d61fceb2105c0be77afd48" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.110s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "aaed931f4796586495d61fceb2105c0be77afd48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "aaed931f4796586495d61fceb2105c0be77afd48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Successfully updated port: f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48,backing_fmt=raw /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-changed-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing instance network info cache due to event network-changed-f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48,backing_fmt=raw /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk 1073741824" returned: 0 in 0.077s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "aaed931f4796586495d61fceb2105c0be77afd48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Cannot resize image /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Ensure instance console log exists: /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance network_info: |[{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing network info cache for port f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Start _get_guest_xml network_info=[{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T14:03:53Z,direct_url=<?>,disk_format='qcow2',id=90d63c40-fc0a-4d0a-b93b-273dffffbffa,min_disk=0,min_ram=0,name='tempest-scenario-img--796959792',owner='cd1d061238f6482c9a10d751ab1d2abd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T14:03:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '90d63c40-fc0a-4d0a-b93b-273dffffbffa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:03:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T14:03:53Z,direct_url=<?>,disk_format='qcow2',id=90d63c40-fc0a-4d0a-b93b-273dffffbffa,min_disk=0,min_ram=0,name='tempest-scenario-img--796959792',owner='cd1d061238f6482c9a10d751ab1d2abd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T14:03:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1220587598',display_name='tempest-TestMinimumBasicScenario-server-1220587598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1220587598',id=40,image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8fJ4GMTaMLuKqPPVYNVBgn2esxqOFf3HigtQN1+PING/Dtkzlrbiqe91ADVBg5XN9xHSmBF3euZPSnYeU5plRbTr3rRTZ91qZu1o5B3XLfQeYUEKqAqnHq288JOoYLow==',key_name='tempest-TestMinimumBasicScenario-1564917942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-kq2d775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:03:56Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=067d8f98-27bb-4060-a03d-523eca3b15b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'pci_devices' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:03:58 user nova-compute[75233]:   <uuid>067d8f98-27bb-4060-a03d-523eca3b15b0</uuid>
Dec 05 14:03:58 user nova-compute[75233]:   <name>instance-00000028</name>
Dec 05 14:03:58 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:03:58 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:03:58 user nova-compute[75233]:   <metadata>
Dec 05 14:03:58 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:03:58 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:03:58 user nova-compute[75233]:       <nova:name>tempest-TestMinimumBasicScenario-server-1220587598</nova:name>
Dec 05 14:03:58 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:03:58</nova:creationTime>
Dec 05 14:03:58 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:03:58 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:03:58 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:03:58 user nova-compute[75233]:       <nova:owner>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:user uuid="6b3ba7c68eeb411a8c3cf77748216e65">tempest-TestMinimumBasicScenario-235565151-project-member</nova:user>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:project uuid="cd1d061238f6482c9a10d751ab1d2abd">tempest-TestMinimumBasicScenario-235565151</nova:project>
Dec 05 14:03:58 user nova-compute[75233]:       </nova:owner>
Dec 05 14:03:58 user nova-compute[75233]:       <nova:root type="image" uuid="90d63c40-fc0a-4d0a-b93b-273dffffbffa"/>
Dec 05 14:03:58 user nova-compute[75233]:       <nova:ports>
Dec 05 14:03:58 user nova-compute[75233]:         <nova:port uuid="f8f03810-26d5-4443-9557-35623e658ffc">
Dec 05 14:03:58 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 14:03:58 user nova-compute[75233]:         </nova:port>
Dec 05 14:03:58 user nova-compute[75233]:       </nova:ports>
Dec 05 14:03:58 user nova-compute[75233]:     </nova:instance>
Dec 05 14:03:58 user nova-compute[75233]:   </metadata>
Dec 05 14:03:58 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:03:58 user nova-compute[75233]:     <system>
Dec 05 14:03:58 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:03:58 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:03:58 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:03:58 user nova-compute[75233]:       <entry name="serial">067d8f98-27bb-4060-a03d-523eca3b15b0</entry>
Dec 05 14:03:58 user nova-compute[75233]:       <entry name="uuid">067d8f98-27bb-4060-a03d-523eca3b15b0</entry>
Dec 05 14:03:58 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:03:58 user nova-compute[75233]:     </system>
Dec 05 14:03:58 user nova-compute[75233]:   </sysinfo>
Dec 05 14:03:58 user nova-compute[75233]:   <os>
Dec 05 14:03:58 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:03:58 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:03:58 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:03:58 user nova-compute[75233]:   </os>
Dec 05 14:03:58 user nova-compute[75233]:   <features>
Dec 05 14:03:58 user nova-compute[75233]:     <acpi/>
Dec 05 14:03:58 user nova-compute[75233]:     <apic/>
Dec 05 14:03:58 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:03:58 user nova-compute[75233]:   </features>
Dec 05 14:03:58 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:03:58 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:03:58 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:03:58 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:03:58 user nova-compute[75233]:   </clock>
Dec 05 14:03:58 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:03:58 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:03:58 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:03:58 user nova-compute[75233]:   </cpu>
Dec 05 14:03:58 user nova-compute[75233]:   <devices>
Dec 05 14:03:58 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:03:58 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:03:58 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk"/>
Dec 05 14:03:58 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:03:58 user nova-compute[75233]:     </disk>
Dec 05 14:03:58 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:03:58 user nova-compute[75233]:       <mac address="fa:16:3e:aa:15:bb"/>
Dec 05 14:03:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:03:58 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:03:58 user nova-compute[75233]:       <target dev="tapf8f03810-26"/>
Dec 05 14:03:58 user nova-compute[75233]:     </interface>
Dec 05 14:03:58 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:03:58 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/console.log" append="off"/>
Dec 05 14:03:58 user nova-compute[75233]:     </serial>
Dec 05 14:03:58 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:03:58 user nova-compute[75233]:     <video>
Dec 05 14:03:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:03:58 user nova-compute[75233]:     </video>
Dec 05 14:03:58 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:03:58 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:03:58 user nova-compute[75233]:     </rng>
Dec 05 14:03:58 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:03:58 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:03:58 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:03:58 user nova-compute[75233]:     </memballoon>
Dec 05 14:03:58 user nova-compute[75233]:   </devices>
Dec 05 14:03:58 user nova-compute[75233]: </domain>
Dec 05 14:03:58 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1220587598',display_name='tempest-TestMinimumBasicScenario-server-1220587598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1220587598',id=40,image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8fJ4GMTaMLuKqPPVYNVBgn2esxqOFf3HigtQN1+PING/Dtkzlrbiqe91ADVBg5XN9xHSmBF3euZPSnYeU5plRbTr3rRTZ91qZu1o5B3XLfQeYUEKqAqnHq288JOoYLow==',key_name='tempest-TestMinimumBasicScenario-1564917942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-kq2d775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:03:56Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=067d8f98-27bb-4060-a03d-523eca3b15b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG os_vif [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46f1faae-8a75-5fb2-9b15-6da1c276a396', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8f03810-26, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8f03810-26, col_values=(('qos', UUID('28387183-9bf2-4e01-a3fb-fc6927126a37')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8f03810-26, col_values=(('external_ids', {'iface-id': 'f8f03810-26d5-4443-9557-35623e658ffc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:15:bb', 'vm-uuid': '067d8f98-27bb-4060-a03d-523eca3b15b0'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:58 user nova-compute[75233]: INFO os_vif [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26')
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No VIF found with MAC fa:16:3e:aa:15:bb, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updated VIF entry in instance network info cache for port f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:03:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-a44d5282-8167-4b70-a416-d6b6ec8a1b86 req-41878500-7c7f-489e-a97c-362570a03295 service nova] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:03:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:03:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-359dd49b-0db2-4b78-9c68-f19c49581916 req-12de7a3f-fc0d-453e-b4b5-099ed2bed579 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-359dd49b-0db2-4b78-9c68-f19c49581916 req-12de7a3f-fc0d-453e-b4b5-099ed2bed579 service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-359dd49b-0db2-4b78-9c68-f19c49581916 req-12de7a3f-fc0d-453e-b4b5-099ed2bed579 service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-359dd49b-0db2-4b78-9c68-f19c49581916 req-12de7a3f-fc0d-453e-b4b5-099ed2bed579 service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-359dd49b-0db2-4b78-9c68-f19c49581916 req-12de7a3f-fc0d-453e-b4b5-099ed2bed579 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:00 user nova-compute[75233]: WARNING nova.compute.manager [req-359dd49b-0db2-4b78-9c68-f19c49581916 req-12de7a3f-fc0d-453e-b4b5-099ed2bed579 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state building and task_state spawning.
Dec 05 14:04:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:04:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance spawned successfully.
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:02 user nova-compute[75233]: INFO nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Took 5.64 seconds to spawn the instance on the hypervisor.
Dec 05 14:04:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-da91d0f0-0bc3-459d-bfcf-383e07b36cf5 req-2893889c-ff1f-4acd-80d8-98c454bb7a46 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-da91d0f0-0bc3-459d-bfcf-383e07b36cf5 req-2893889c-ff1f-4acd-80d8-98c454bb7a46 service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-da91d0f0-0bc3-459d-bfcf-383e07b36cf5 req-2893889c-ff1f-4acd-80d8-98c454bb7a46 service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-da91d0f0-0bc3-459d-bfcf-383e07b36cf5 req-2893889c-ff1f-4acd-80d8-98c454bb7a46 service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-da91d0f0-0bc3-459d-bfcf-383e07b36cf5 req-2893889c-ff1f-4acd-80d8-98c454bb7a46 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:02 user nova-compute[75233]: WARNING nova.compute.manager [req-da91d0f0-0bc3-459d-bfcf-383e07b36cf5 req-2893889c-ff1f-4acd-80d8-98c454bb7a46 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state building and task_state spawning.
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:02 user nova-compute[75233]: INFO nova.compute.manager [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Took 6.52 seconds to build instance.
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-84058831-853e-4021-9924-ff4ec3b3090b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.630s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:04:04 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=24.814590454101562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 067d8f98-27bb-4060-a03d-523eca3b15b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:04:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:04:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:04:13 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:04:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:04:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:04:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:04:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:04:23 user nova-compute[75233]: INFO nova.compute.claims [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Claim successful on node user
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:04:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:04:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.policy [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '317f3e447b58464eb428e63ac23f80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536eea64226a4234a4603ba5cf20cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:04:24 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Creating image(s)
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk 1073741824" returned: 0 in 0.052s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Successfully created port: ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Cannot resize image /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Ensure instance console log exists: /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Successfully updated port: ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquired lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-changed-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.compute.manager [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Refreshing instance network info cache due to event network-changed-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] Acquiring lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Releasing lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance network_info: |[{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] Acquired lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.neutron [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Refreshing network info cache for port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Start _get_guest_xml network_info=[{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:04:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:04:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1899445961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1899445961',id=41,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXFwYzx8M05odD/u1teARHibQoH7IywQyT7UL/Vbj4kW9HjQg2zqv+V/6BJcoNQGTglRTQsVGLjCbMBYWDmrUlkr4voJ7cUdOJU/pIal5WS4/nGltwiR+NZNeq1ebLu7Q==',key_name='tempest-keypair-1905971800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-iron191t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=ce34db0a-bdc8-4379-8987-1ed437357311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.objects.instance [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'pci_devices' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:04:25 user nova-compute[75233]:   <uuid>ce34db0a-bdc8-4379-8987-1ed437357311</uuid>
Dec 05 14:04:25 user nova-compute[75233]:   <name>instance-00000029</name>
Dec 05 14:04:25 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:04:25 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:04:25 user nova-compute[75233]:   <metadata>
Dec 05 14:04:25 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:04:25 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:04:25 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1899445961</nova:name>
Dec 05 14:04:25 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:04:25</nova:creationTime>
Dec 05 14:04:25 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:04:25 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:04:25 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:04:25 user nova-compute[75233]:       <nova:owner>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:user uuid="317f3e447b58464eb428e63ac23f80c6">tempest-AttachVolumeShelveTestJSON-1457724058-project-member</nova:user>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:project uuid="536eea64226a4234a4603ba5cf20cf1c">tempest-AttachVolumeShelveTestJSON-1457724058</nova:project>
Dec 05 14:04:25 user nova-compute[75233]:       </nova:owner>
Dec 05 14:04:25 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:04:25 user nova-compute[75233]:       <nova:ports>
Dec 05 14:04:25 user nova-compute[75233]:         <nova:port uuid="ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e">
Dec 05 14:04:25 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 14:04:25 user nova-compute[75233]:         </nova:port>
Dec 05 14:04:25 user nova-compute[75233]:       </nova:ports>
Dec 05 14:04:25 user nova-compute[75233]:     </nova:instance>
Dec 05 14:04:25 user nova-compute[75233]:   </metadata>
Dec 05 14:04:25 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:04:25 user nova-compute[75233]:     <system>
Dec 05 14:04:25 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:04:25 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:04:25 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:04:25 user nova-compute[75233]:       <entry name="serial">ce34db0a-bdc8-4379-8987-1ed437357311</entry>
Dec 05 14:04:25 user nova-compute[75233]:       <entry name="uuid">ce34db0a-bdc8-4379-8987-1ed437357311</entry>
Dec 05 14:04:25 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:04:25 user nova-compute[75233]:     </system>
Dec 05 14:04:25 user nova-compute[75233]:   </sysinfo>
Dec 05 14:04:25 user nova-compute[75233]:   <os>
Dec 05 14:04:25 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:04:25 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:04:25 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:04:25 user nova-compute[75233]:   </os>
Dec 05 14:04:25 user nova-compute[75233]:   <features>
Dec 05 14:04:25 user nova-compute[75233]:     <acpi/>
Dec 05 14:04:25 user nova-compute[75233]:     <apic/>
Dec 05 14:04:25 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:04:25 user nova-compute[75233]:   </features>
Dec 05 14:04:25 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:04:25 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:04:25 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:04:25 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:04:25 user nova-compute[75233]:   </clock>
Dec 05 14:04:25 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:04:25 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:04:25 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:04:25 user nova-compute[75233]:   </cpu>
Dec 05 14:04:25 user nova-compute[75233]:   <devices>
Dec 05 14:04:25 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:04:25 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:04:25 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk"/>
Dec 05 14:04:25 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:04:25 user nova-compute[75233]:     </disk>
Dec 05 14:04:25 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:04:25 user nova-compute[75233]:       <mac address="fa:16:3e:0c:58:cd"/>
Dec 05 14:04:25 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:04:25 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:04:25 user nova-compute[75233]:       <target dev="tapffe999fc-54"/>
Dec 05 14:04:25 user nova-compute[75233]:     </interface>
Dec 05 14:04:25 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:04:25 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/console.log" append="off"/>
Dec 05 14:04:25 user nova-compute[75233]:     </serial>
Dec 05 14:04:25 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:04:25 user nova-compute[75233]:     <video>
Dec 05 14:04:25 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:04:25 user nova-compute[75233]:     </video>
Dec 05 14:04:25 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:04:25 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:04:25 user nova-compute[75233]:     </rng>
Dec 05 14:04:25 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:04:25 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:04:25 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:04:25 user nova-compute[75233]:     </memballoon>
Dec 05 14:04:25 user nova-compute[75233]:   </devices>
Dec 05 14:04:25 user nova-compute[75233]: </domain>
Dec 05 14:04:25 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1899445961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1899445961',id=41,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXFwYzx8M05odD/u1teARHibQoH7IywQyT7UL/Vbj4kW9HjQg2zqv+V/6BJcoNQGTglRTQsVGLjCbMBYWDmrUlkr4voJ7cUdOJU/pIal5WS4/nGltwiR+NZNeq1ebLu7Q==',key_name='tempest-keypair-1905971800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-iron191t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=ce34db0a-bdc8-4379-8987-1ed437357311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG os_vif [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60ce6647-8183-51d3-8f43-5f0c7f4a736d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffe999fc-54, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffe999fc-54, col_values=(('qos', UUID('1c853965-552a-4564-9b8f-58d92bc1799c')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffe999fc-54, col_values=(('external_ids', {'iface-id': 'ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:58:cd', 'vm-uuid': 'ce34db0a-bdc8-4379-8987-1ed437357311'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:25 user nova-compute[75233]: INFO os_vif [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54')
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:04:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No VIF found with MAC fa:16:3e:0c:58:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:04:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updated VIF entry in instance network info cache for port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:04:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:04:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8be02161-1d07-4040-9e1e-38702556c8cc req-c325fddb-66ad-40fe-8ca3-821d97ddb4c2 service nova] Releasing lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-93730864-5e34-475b-8df2-15f6264bc566 req-d843a6ed-5476-48dd-98be-d5212d9e7b08 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-93730864-5e34-475b-8df2-15f6264bc566 req-d843a6ed-5476-48dd-98be-d5212d9e7b08 service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-93730864-5e34-475b-8df2-15f6264bc566 req-d843a6ed-5476-48dd-98be-d5212d9e7b08 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-93730864-5e34-475b-8df2-15f6264bc566 req-d843a6ed-5476-48dd-98be-d5212d9e7b08 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG nova.compute.manager [req-93730864-5e34-475b-8df2-15f6264bc566 req-d843a6ed-5476-48dd-98be-d5212d9e7b08 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:27 user nova-compute[75233]: WARNING nova.compute.manager [req-93730864-5e34-475b-8df2-15f6264bc566 req-d843a6ed-5476-48dd-98be-d5212d9e7b08 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state building and task_state spawning.
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:04:29 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance spawned successfully.
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:04:29 user nova-compute[75233]: INFO nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Took 5.13 seconds to spawn the instance on the hypervisor.
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:04:29 user nova-compute[75233]: INFO nova.compute.manager [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Took 5.86 seconds to build instance.
Dec 05 14:04:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-90bc9496-478b-4004-98a6-d49d4a1f24de tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.953s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-b19e3b88-20e2-4e22-9479-97599514a056 req-04a11f66-f7c7-4e94-a3b3-4464af361c5f service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b19e3b88-20e2-4e22-9479-97599514a056 req-04a11f66-f7c7-4e94-a3b3-4464af361c5f service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b19e3b88-20e2-4e22-9479-97599514a056 req-04a11f66-f7c7-4e94-a3b3-4464af361c5f service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b19e3b88-20e2-4e22-9479-97599514a056 req-04a11f66-f7c7-4e94-a3b3-4464af361c5f service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:29 user nova-compute[75233]: DEBUG nova.compute.manager [req-b19e3b88-20e2-4e22-9479-97599514a056 req-04a11f66-f7c7-4e94-a3b3-4464af361c5f service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:29 user nova-compute[75233]: WARNING nova.compute.manager [req-b19e3b88-20e2-4e22-9479-97599514a056 req-04a11f66-f7c7-4e94-a3b3-4464af361c5f service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state active and task_state None.
Dec 05 14:04:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:53 user nova-compute[75233]: INFO nova.compute.manager [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Unrescuing
Dec 05 14:04:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:04:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquired lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:04:53 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG nova.network.neutron [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Releasing lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'flavor' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-854364ba-fad8-43cf-b033-35cbfb92f736 req-ab515b75-dc33-425e-b59c-8e9548d4e621 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-854364ba-fad8-43cf-b033-35cbfb92f736 req-ab515b75-dc33-425e-b59c-8e9548d4e621 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-854364ba-fad8-43cf-b033-35cbfb92f736 req-ab515b75-dc33-425e-b59c-8e9548d4e621 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-854364ba-fad8-43cf-b033-35cbfb92f736 req-ab515b75-dc33-425e-b59c-8e9548d4e621 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-854364ba-fad8-43cf-b033-35cbfb92f736 req-ab515b75-dc33-425e-b59c-8e9548d4e621 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:54 user nova-compute[75233]: WARNING nova.compute.manager [req-854364ba-fad8-43cf-b033-35cbfb92f736 req-ab515b75-dc33-425e-b59c-8e9548d4e621 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state rescued and task_state unrescuing.
Dec 05 14:04:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance destroyed successfully.
Dec 05 14:04:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:56 user nova-compute[75233]: WARNING nova.compute.manager [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state rescued and task_state unrescuing.
Dec 05 14:04:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:56 user nova-compute[75233]: WARNING nova.compute.manager [req-0676c90b-0307-43a8-9a39-489c8c56f00e req-97db28c4-5a34-4803-80ac-70a771b564b9 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state rescued and task_state unrescuing.
Dec 05 14:04:57 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:04:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6060e485-f31e-461e-938f-09a96231bd2f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:04:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-552de0e3-1f52-4fcd-be80-219c3693f8df req-ba4618ae-e241-44c7-98fe-d219b3f17811 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:04:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-552de0e3-1f52-4fcd-be80-219c3693f8df req-ba4618ae-e241-44c7-98fe-d219b3f17811 service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:04:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-552de0e3-1f52-4fcd-be80-219c3693f8df req-ba4618ae-e241-44c7-98fe-d219b3f17811 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:04:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-552de0e3-1f52-4fcd-be80-219c3693f8df req-ba4618ae-e241-44c7-98fe-d219b3f17811 service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:04:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-552de0e3-1f52-4fcd-be80-219c3693f8df req-ba4618ae-e241-44c7-98fe-d219b3f17811 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:04:58 user nova-compute[75233]: WARNING nova.compute.manager [req-552de0e3-1f52-4fcd-be80-219c3693f8df req-ba4618ae-e241-44c7-98fe-d219b3f17811 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state active and task_state None.
Dec 05 14:05:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:03 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:03 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:05:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:05:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:05:06 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8199MB free_disk=24.755447387695312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 067d8f98-27bb-4060-a03d-523eca3b15b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ce34db0a-bdc8-4379-8987-1ed437357311 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:05:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:05:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:05:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Updating instance_info_cache with network_info: [{"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:05:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-bdded23f-3fff-443e-af17-90145e598f9e" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:05:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:05:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:05:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-changed-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Refreshing instance network info cache due to event network-changed-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] Acquiring lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] Acquired lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG nova.network.neutron [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Refreshing network info cache for port e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG nova.network.neutron [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updated VIF entry in instance network info cache for port e8e2a350-bc1c-4b64-b7f4-73bbe37679fc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG nova.network.neutron [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating instance_info_cache with network_info: [{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-62e020b6-0956-4293-ba42-bc3396d34939 req-46c4ded8-4e34-4f96-a16c-288d3c0ca15e service nova] Releasing lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'flavor' on Instance uuid 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:05:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:29 user nova-compute[75233]: INFO nova.compute.manager [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Attaching volume a9a74f9f-e758-486e-b743-71dd99a4b65b to /dev/vdb
Dec 05 14:05:29 user nova-compute[75233]: DEBUG os_brick.utils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7bbc8c-390b-458d-872c-f4cda7c105de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c926553c-bb60-480e-9ad0-89f4b3437832]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceed6cf-2d85-40f5-b526-a5b236e1f5b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f23257f-3d9a-4489-921a-d0c3dfb28731]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:05:29 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:05:29 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf4bc42-5944-4629-ac34-59357bc921c7]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG os_brick.utils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:05:29 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating existing volume attachment record: 79d3a724-c81a-4417-b184-ecd5f08e7095 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:05:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 3f5b5067-5f96-48a8-a6da-7630b1a972d6 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid bdded23f-3fff-443e-af17-90145e598f9e {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bdded23f-3fff-443e-af17-90145e598f9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bdded23f-3fff-443e-af17-90145e598f9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVcsjlag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:05:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:05:38 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:05:38 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2353e2-883f-4511-af67-167f3bf5e3f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:05:38 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fd90c-4bac-4933-927b-d9ecc680a45b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b] added
Dec 05 14:05:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba08ef4-88bd-4d5d-9605-69fa68842dfa]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a519fb8-374f-4bd2-a7e0-048f3b70e242]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVcsjlag {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVcsjlag" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[006508de-eddb-4af6-a0e7-d56840502a02]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IVcsjlag'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf23290-a943-4976-95b6-2fae367bcef7]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daafb59-e9e3-4dfb-803d-f621c57f55b3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:38 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:38 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --login" returned: 0 in 0.144s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[accedd65-bc6e-44df-ac4b-fcc1dc18ed82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260]
Dec 05 14:05:38 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260] successful.
Dec 05 14:05:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df59624-afa0-4acb-b271-f76cfbad6770]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4578d-6b42-48e9-b465-247c9b7b5442]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:38 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:38 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:05:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:38 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:38 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:05:38 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37421f-8494-42e1-891c-19107943a2f0]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:38 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVcsjlag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26237306636346464', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237306636346464', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'flavor' on Instance uuid 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:05:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:05:39 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:05:39 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:05:39 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:05:39 user nova-compute[75233]:   <serial>a9a74f9f-e758-486e-b743-71dd99a4b65b</serial>
Dec 05 14:05:39 user nova-compute[75233]: </disk>
Dec 05 14:05:39 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No VIF found with MAC fa:16:3e:94:cc:11, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e9f99548-6041-49d7-ad6c-9091d0cabbde tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.257s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.137s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:42 user nova-compute[75233]: INFO nova.compute.manager [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Detaching volume a9a74f9f-e758-486e-b743-71dd99a4b65b
Dec 05 14:05:42 user nova-compute[75233]: INFO nova.virt.block_device [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Attempting to driver detach volume a9a74f9f-e758-486e-b743-71dd99a4b65b from mountpoint /dev/vdb
Dec 05 14:05:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Attempting to detach device vdb from instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:05:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:05:42 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:05:42 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:05:42 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:05:42 user nova-compute[75233]:   <serial>a9a74f9f-e758-486e-b743-71dd99a4b65b</serial>
Dec 05 14:05:42 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:05:42 user nova-compute[75233]: </disk>
Dec 05 14:05:42 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:05:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully detached device vdb from instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 from the persistent domain config.
Dec 05 14:05:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:05:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:05:42 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:05:42 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:05:42 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:05:42 user nova-compute[75233]:   <serial>a9a74f9f-e758-486e-b743-71dd99a4b65b</serial>
Dec 05 14:05:42 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:05:42 user nova-compute[75233]: </disk>
Dec 05 14:05:42 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:05:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:05:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'flavor' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:05:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:05:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:05:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:05:48 user nova-compute[75233]: INFO nova.compute.manager [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Attaching volume fe5d7ec7-2c2c-4453-afc6-0171fa79d361 to /dev/vdb
Dec 05 14:05:49 user nova-compute[75233]: DEBUG os_brick.utils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b9f6d2-e3e2-4821-a3c8-9a4e07d2862f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda88494-5e3f-4906-9c40-a5da9f9f2012]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca0230-deb9-4724-858a-d51bd45d637a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc0ce9-4ae8-4211-97e6-d1cbb1dd9526]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:05:49 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:05:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71f5f2c-2e51-460f-bea5-1a1b156d3c3b]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG os_brick.utils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:05:49 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating existing volume attachment record: 133451ec-f3c5-4cb0-93d1-efb4db80b8d6 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:05:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:05:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:05:57 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:05:58 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:05:58 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:05:58 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f4304-ebe7-43f0-8c6b-e5f5b3358053]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:05:58 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d839b9af-e921-4cfe-9182-b526697a3a6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361] added
Dec 05 14:05:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d62e164-419c-4568-a9a0-a42fffb079f6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e476e-02e5-4a0d-b385-543a01984d48]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMNKnOUV {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMNKnOUV" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb1ee6-6a48-4436-ab02-ea53fae43b6d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMNKnOUV'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6247fd1-1513-41f9-905f-ca409f36d919]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[49300e65-1ded-45ad-85fb-e2a0ac7c4cd0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:05:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:05:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ba80f-35e3-48af-809c-36fba2b7356f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]
Dec 05 14:05:58 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.
Dec 05 14:05:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ab954-7c27-4516-af24-fdd2229a408d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238ee03-7490-4e21-b3dc-b7c85d6a1d6c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:05:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:05:58 user nova-compute[75233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:05:58 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e32e73-ffc0-4daa-a0a5-397120b96c3b]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:05:58 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23836633234343038', 'path': '/dev/sdd'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836633234343038', 'path': '/dev/sdd'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'flavor' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:05:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:05:59 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:05:59 user nova-compute[75233]:   <source dev="/dev/sdd"/>
Dec 05 14:05:59 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:05:59 user nova-compute[75233]:   <serial>fe5d7ec7-2c2c-4453-afc6-0171fa79d361</serial>
Dec 05 14:05:59 user nova-compute[75233]: </disk>
Dec 05 14:05:59 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No VIF found with MAC fa:16:3e:aa:15:bb, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b0d63c71-c855-408d-b850-2af35482a158 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.365s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:03 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 is timed out.
Dec 05 14:06:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully detached device vdb from instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 from the live domain config.
Dec 05 14:06:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVcsjlag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:06:03 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5311997-fc8a-4cbf-abf5-8bd54322c481]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:06:03 user nova-compute[75233]: No targets found.
Dec 05 14:06:03 user nova-compute[75233]: iSNS:
Dec 05 14:06:03 user nova-compute[75233]: No targets found.
Dec 05 14:06:03 user nova-compute[75233]: STATIC:
Dec 05 14:06:03 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 14:06:03 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:03 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:03 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b
Dec 05 14:06:03 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:03 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:03 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361
Dec 05 14:06:03 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:03 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:03 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60
Dec 05 14:06:03 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:03 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:03 user nova-compute[75233]: FIRMWARE:
Dec 05 14:06:03 user nova-compute[75233]: No targets found.
Dec 05 14:06:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:06:03 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:06:03 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af8d98a-25bf-41d1-92dc-07c30f7aabe3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d5452-ea89-4fc7-a1ed-f3790fda9944]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:03 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:03 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:06:03 user nova-compute[75233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:03 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:03 user nova-compute[75233]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b (non-flash)
Dec 05 14:06:03 user nova-compute[75233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34774f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c26da1-7c7a-4a22-bb6d-b486ffd50327]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2942a4ef-f72a-49c6-a94b-709c9fc233cb]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc5e42-b5d8-4013-8d46-b7280fc0fa27]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb99c15-ba10-439f-9ca8-3059ae71e2e9]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3245f9-4168-4211-9904-5548f4f01c7c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff13ba3-775e-4a69-814e-a8d38e139c33]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260]
Dec 05 14:06:03 user nova-compute[75233]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b, portal: 172.16.0.220,3260] successful.
Dec 05 14:06:03 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a74f9f-e758-486e-b743-71dd99a4b65b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa005e83-1c84-4c9d-8871-a04b012c64bf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] <== disconnect_volume: return (326ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:06:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG nova.objects.instance [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'flavor' on Instance uuid 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3b2cef97-38fc-4f69-a8e7-dcebf04241f0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.806s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:04 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-changed-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing instance network info cache due to event network-changed-f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing network info cache for port f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:06:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:06:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8299MB free_disk=24.738121032714844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 067d8f98-27bb-4060-a03d-523eca3b15b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ce34db0a-bdc8-4379-8987-1ed437357311 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updated VIF entry in instance network info cache for port f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c38b6c9d-b1ac-4e15-9b53-aad6dc0187d3 req-e07e59af-7213-420e-a93a-bd526b59cb0b service nova] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-changed-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing instance network info cache due to event network-changed-f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing network info cache for port f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updated VIF entry in instance network info cache for port f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0eb37f9c-4297-4723-8498-28fc89f25942 req-1e730510-1538-4a1b-90ab-353d36773a6c service nova] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-changed-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Refreshing instance network info cache due to event network-changed-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] Acquiring lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] Acquired lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Refreshing network info cache for port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:14 user nova-compute[75233]: INFO nova.compute.manager [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Rebooting instance
Dec 05 14:06:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updated VIF entry in instance network info cache for port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6e5d8679-2cd8-4f22-a1d1-b4f3c9550200 req-523b5d12-e94d-47d4-881e-e6a0f8a1a32b service nova] Releasing lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:16 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance destroyed successfully.
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'resources' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1220587598',display_name='tempest-TestMinimumBasicScenario-server-1220587598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1220587598',id=40,image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8fJ4GMTaMLuKqPPVYNVBgn2esxqOFf3HigtQN1+PING/Dtkzlrbiqe91ADVBg5XN9xHSmBF3euZPSnYeU5plRbTr3rRTZ91qZu1o5B3XLfQeYUEKqAqnHq288JOoYLow==',key_name='tempest-TestMinimumBasicScenario-1564917942',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-kq2d775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:06:15Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=067d8f98-27bb-4060-a03d-523eca3b15b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8f03810-26, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28387183-9bf2-4e01-a3fb-fc6927126a37) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:16 user nova-compute[75233]: INFO os_vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26')
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:06:16 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8977c-191b-4c11-88cf-e2d9051fe13f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:06:16 user nova-compute[75233]: No targets found.
Dec 05 14:06:16 user nova-compute[75233]: iSNS:
Dec 05 14:06:16 user nova-compute[75233]: No targets found.
Dec 05 14:06:16 user nova-compute[75233]: STATIC:
Dec 05 14:06:16 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 14:06:16 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:16 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:16 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361
Dec 05 14:06:16 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:16 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:16 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60
Dec 05 14:06:16 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:16 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:16 user nova-compute[75233]: FIRMWARE:
Dec 05 14:06:16 user nova-compute[75233]: No targets found.
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:06:16 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:06:16 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7a735f-719b-4a0d-b9c0-96fe35723a04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9983a6-8c1f-4c06-b096-48154b185251]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582c16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361'): ({'sdd'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Removing single pathed devices sdd {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12424561-714e-4534-9632-a6274c939c1d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb1567-3569-4b13-8188-c14b86547351]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flushing IO for device /dev/sdd {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a59e5-5979-4aed-9e9b-050327b41e4a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-unplugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-unplugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:16 user nova-compute[75233]: WARNING nova.compute.manager [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-unplugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state active and task_state reboot_started_hard.
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:16 user nova-compute[75233]: WARNING nova.compute.manager [req-9fe7433b-93fe-472d-9c3f-59bab52ad139 req-48535d29-2858-4b1f-813c-03287e269c5f service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state active and task_state reboot_started_hard.
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d48709-549b-40e5-bf60-c3b182cb6dde]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] SCSI volumes sdd have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b630bae6-e387-4fb5-a340-52c5a4bab81a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[426389b7-f516-47bd-acaa-8eb55e6ee247]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]
Dec 05 14:06:16 user nova-compute[75233]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e29f97-134d-4fa8-8774-d1892127fe2b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== disconnect_volume: return (295ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Start _get_guest_xml network_info=[{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90d63c40-fc0a-4d0a-b93b-273dffffbffa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '90d63c40-fc0a-4d0a-b93b-273dffffbffa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '067d8f98-27bb-4060-a03d-523eca3b15b0', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'serial': 'fe5d7ec7-2c2c-4453-afc6-0171fa79d361'}, 'delete_on_termination': False, 'attachment_id': '133451ec-f3c5-4cb0-93d1-efb4db80b8d6', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:06:16 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:06:16 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=90d63c40-fc0a-4d0a-b93b-273dffffbffa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'vcpu_model' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.objects.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Object Instance<067d8f98-27bb-4060-a03d-523eca3b15b0> lazy-loaded attributes: resources,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:06:16 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:06:16 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:06:16 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e5e9b-c773-4a3c-b00a-d07abe00f9d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:06:16 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a15c34-b65e-436c-9616-ab462ad34894]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361] added
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b5d2f-39fc-44d4-9437-71809d1d22da]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9039fa2-3c5c-45a0-807d-41e52998d792]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMNKnOUV {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMNKnOUV" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04a3d65-d208-4331-b27f-5686a8f92438]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMNKnOUV'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77288d83-76b6-4818-8a2b-9256d100fc9e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e13c82-bbec-435f-b5c9-11a67ea9bb04]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d0ee9-c2e3-4655-b0db-a2da5a5afd78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]
Dec 05 14:06:16 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f633c-c30a-44a4-8275-c414cb5d1175]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed245a-bb3e-435d-b8c1-43f4ca6b06ca]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:16 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40a87a6-ec69-484d-b7a8-e7e2dea8cb0c]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:06:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [{"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-5d7dcc32-4c98-49c0-83de-edfb17fde4f2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23836633234343038', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836633234343038', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1220587598',display_name='tempest-TestMinimumBasicScenario-server-1220587598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1220587598',id=40,image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8fJ4GMTaMLuKqPPVYNVBgn2esxqOFf3HigtQN1+PING/Dtkzlrbiqe91ADVBg5XN9xHSmBF3euZPSnYeU5plRbTr3rRTZ91qZu1o5B3XLfQeYUEKqAqnHq288JOoYLow==',key_name='tempest-TestMinimumBasicScenario-1564917942',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-kq2d775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:06:15Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=067d8f98-27bb-4060-a03d-523eca3b15b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'pci_devices' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.objects.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Object Instance<067d8f98-27bb-4060-a03d-523eca3b15b0> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:06:17 user nova-compute[75233]:   <uuid>067d8f98-27bb-4060-a03d-523eca3b15b0</uuid>
Dec 05 14:06:17 user nova-compute[75233]:   <name>instance-00000028</name>
Dec 05 14:06:17 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:06:17 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:06:17 user nova-compute[75233]:   <metadata>
Dec 05 14:06:17 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:06:17 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:06:17 user nova-compute[75233]:       <nova:name>tempest-TestMinimumBasicScenario-server-1220587598</nova:name>
Dec 05 14:06:17 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:06:16</nova:creationTime>
Dec 05 14:06:17 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:06:17 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:06:17 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:06:17 user nova-compute[75233]:       <nova:owner>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:user uuid="6b3ba7c68eeb411a8c3cf77748216e65">tempest-TestMinimumBasicScenario-235565151-project-member</nova:user>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:project uuid="cd1d061238f6482c9a10d751ab1d2abd">tempest-TestMinimumBasicScenario-235565151</nova:project>
Dec 05 14:06:17 user nova-compute[75233]:       </nova:owner>
Dec 05 14:06:17 user nova-compute[75233]:       <nova:root type="image" uuid="90d63c40-fc0a-4d0a-b93b-273dffffbffa"/>
Dec 05 14:06:17 user nova-compute[75233]:       <nova:ports>
Dec 05 14:06:17 user nova-compute[75233]:         <nova:port uuid="f8f03810-26d5-4443-9557-35623e658ffc">
Dec 05 14:06:17 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 14:06:17 user nova-compute[75233]:         </nova:port>
Dec 05 14:06:17 user nova-compute[75233]:       </nova:ports>
Dec 05 14:06:17 user nova-compute[75233]:     </nova:instance>
Dec 05 14:06:17 user nova-compute[75233]:   </metadata>
Dec 05 14:06:17 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:06:17 user nova-compute[75233]:     <system>
Dec 05 14:06:17 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:06:17 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:06:17 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:06:17 user nova-compute[75233]:       <entry name="serial">067d8f98-27bb-4060-a03d-523eca3b15b0</entry>
Dec 05 14:06:17 user nova-compute[75233]:       <entry name="uuid">067d8f98-27bb-4060-a03d-523eca3b15b0</entry>
Dec 05 14:06:17 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:06:17 user nova-compute[75233]:     </system>
Dec 05 14:06:17 user nova-compute[75233]:   </sysinfo>
Dec 05 14:06:17 user nova-compute[75233]:   <os>
Dec 05 14:06:17 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:06:17 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:06:17 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:06:17 user nova-compute[75233]:   </os>
Dec 05 14:06:17 user nova-compute[75233]:   <features>
Dec 05 14:06:17 user nova-compute[75233]:     <acpi/>
Dec 05 14:06:17 user nova-compute[75233]:     <apic/>
Dec 05 14:06:17 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:06:17 user nova-compute[75233]:   </features>
Dec 05 14:06:17 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:06:17 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:06:17 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:06:17 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:06:17 user nova-compute[75233]:   </clock>
Dec 05 14:06:17 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:06:17 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:06:17 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:06:17 user nova-compute[75233]:   </cpu>
Dec 05 14:06:17 user nova-compute[75233]:   <devices>
Dec 05 14:06:17 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:06:17 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:06:17 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk"/>
Dec 05 14:06:17 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:06:17 user nova-compute[75233]:     </disk>
Dec 05 14:06:17 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:06:17 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:06:17 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 14:06:17 user nova-compute[75233]:       <target dev="vdb" bus="virtio"/>
Dec 05 14:06:17 user nova-compute[75233]:       <serial>fe5d7ec7-2c2c-4453-afc6-0171fa79d361</serial>
Dec 05 14:06:17 user nova-compute[75233]:     </disk>
Dec 05 14:06:17 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:06:17 user nova-compute[75233]:       <mac address="fa:16:3e:aa:15:bb"/>
Dec 05 14:06:17 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:06:17 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:06:17 user nova-compute[75233]:       <target dev="tapf8f03810-26"/>
Dec 05 14:06:17 user nova-compute[75233]:     </interface>
Dec 05 14:06:17 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:06:17 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/console.log" append="off"/>
Dec 05 14:06:17 user nova-compute[75233]:     </serial>
Dec 05 14:06:17 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:06:17 user nova-compute[75233]:     <video>
Dec 05 14:06:17 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:06:17 user nova-compute[75233]:     </video>
Dec 05 14:06:17 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:06:17 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:06:17 user nova-compute[75233]:     </rng>
Dec 05 14:06:17 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:06:17 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:06:17 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:06:17 user nova-compute[75233]:     </memballoon>
Dec 05 14:06:17 user nova-compute[75233]:   </devices>
Dec 05 14:06:17 user nova-compute[75233]: </domain>
Dec 05 14:06:17 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:17 user nova-compute[75233]: INFO nova.compute.manager [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Shelving
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'trusted_certs' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Object Instance<067d8f98-27bb-4060-a03d-523eca3b15b0> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-38cc020c-800e-4466-a0bc-b68e3c9638a8 req-0130b12b-bd92-4507-9391-e50b6c3a695c service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-unplugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-38cc020c-800e-4466-a0bc-b68e3c9638a8 req-0130b12b-bd92-4507-9391-e50b6c3a695c service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-38cc020c-800e-4466-a0bc-b68e3c9638a8 req-0130b12b-bd92-4507-9391-e50b6c3a695c service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-38cc020c-800e-4466-a0bc-b68e3c9638a8 req-0130b12b-bd92-4507-9391-e50b6c3a695c service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-38cc020c-800e-4466-a0bc-b68e3c9638a8 req-0130b12b-bd92-4507-9391-e50b6c3a695c service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-unplugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:18 user nova-compute[75233]: WARNING nova.compute.manager [req-38cc020c-800e-4466-a0bc-b68e3c9638a8 req-0130b12b-bd92-4507-9391-e50b6c3a695c service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-unplugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state active and task_state shelving.
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance destroyed successfully.
Dec 05 14:06:18 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Beginning cold snapshot process
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Cannot resize image /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'migration_context' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.objects.base [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Object Instance<067d8f98-27bb-4060-a03d-523eca3b15b0> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1220587598',display_name='tempest-TestMinimumBasicScenario-server-1220587598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1220587598',id=40,image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8fJ4GMTaMLuKqPPVYNVBgn2esxqOFf3HigtQN1+PING/Dtkzlrbiqe91ADVBg5XN9xHSmBF3euZPSnYeU5plRbTr3rRTZ91qZu1o5B3XLfQeYUEKqAqnHq288JOoYLow==',key_name='tempest-TestMinimumBasicScenario-1564917942',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-kq2d775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:06:15Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=067d8f98-27bb-4060-a03d-523eca3b15b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG os_vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46f1faae-8a75-5fb2-9b15-6da1c276a396', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8f03810-26, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8f03810-26, col_values=(('qos', UUID('6da8631a-eb96-4d51-b9f9-ac91119cee0e')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8f03810-26, col_values=(('external_ids', {'iface-id': 'f8f03810-26d5-4443-9557-35623e658ffc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:15:bb', 'vm-uuid': '067d8f98-27bb-4060-a03d-523eca3b15b0'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:18 user nova-compute[75233]: INFO os_vif [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26')
Dec 05 14:06:18 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:06:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk /opt/stack/data/nova/instances/snapshots/tmp1notv06a/fc0e326db95c494c90f23eee65531609 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk /opt/stack/data/nova/instances/snapshots/tmp1notv06a/fc0e326db95c494c90f23eee65531609" returned: 0 in 0.564s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:19 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Snapshot extracted, beginning image upload
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:20 user nova-compute[75233]: WARNING nova.compute.manager [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state active and task_state shelving_image_uploading.
Dec 05 14:06:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:20 user nova-compute[75233]: WARNING nova.compute.manager [req-2764d46e-7d3a-4968-a607-824b73cc72af req-71b29348-82c9-480c-8292-4cbfa9c6fb54 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state active and task_state reboot_started_hard.
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Snapshot image upload complete
Dec 05 14:06:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:06:22 user nova-compute[75233]: INFO nova.compute.manager [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Shelve offloading
Dec 05 14:06:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance destroyed successfully.
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquired lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:06:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance rebooted successfully.
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-5682c9c0-ed9a-4377-ab35-83d784bf7d9d tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.661s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-592b0a7b-13fc-4488-9fe4-8c67f86d790e req-28de8b60-f960-4629-9d6b-76d4e1d8ec9c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592b0a7b-13fc-4488-9fe4-8c67f86d790e req-28de8b60-f960-4629-9d6b-76d4e1d8ec9c service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592b0a7b-13fc-4488-9fe4-8c67f86d790e req-28de8b60-f960-4629-9d6b-76d4e1d8ec9c service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-592b0a7b-13fc-4488-9fe4-8c67f86d790e req-28de8b60-f960-4629-9d6b-76d4e1d8ec9c service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-592b0a7b-13fc-4488-9fe4-8c67f86d790e req-28de8b60-f960-4629-9d6b-76d4e1d8ec9c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:22 user nova-compute[75233]: WARNING nova.compute.manager [req-592b0a7b-13fc-4488-9fe4-8c67f86d790e req-28de8b60-f960-4629-9d6b-76d4e1d8ec9c service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state active and task_state None.
Dec 05 14:06:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Releasing lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance destroyed successfully.
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'resources' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1899445961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1899445961',id=41,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXFwYzx8M05odD/u1teARHibQoH7IywQyT7UL/Vbj4kW9HjQg2zqv+V/6BJcoNQGTglRTQsVGLjCbMBYWDmrUlkr4voJ7cUdOJU/pIal5WS4/nGltwiR+NZNeq1ebLu7Q==',key_name='tempest-keypair-1905971800',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-iron191t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member',shelved_at='2023-12-05T14:06:21.962003',shelved_host='user',shelved_image_id='511be692-f34a-4274-a79b-986c5b9a88f9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=ce34db0a-bdc8-4379-8987-1ed437357311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:22 user nova-compute[75233]: DEBUG os_vif [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffe999fc-54, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c853965-552a-4564-9b8f-58d92bc1799c) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:23 user nova-compute[75233]: INFO os_vif [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54')
Dec 05 14:06:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Deleting instance files /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311_del
Dec 05 14:06:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Deletion of /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311_del complete
Dec 05 14:06:23 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Deleted allocations for instance ce34db0a-bdc8-4379-8987-1ed437357311
Dec 05 14:06:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG nova.objects.instance [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'numa_topology' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG nova.objects.base [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<ce34db0a-bdc8-4379-8987-1ed437357311> lazy-loaded attributes: resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-7c02b99d-16c8-4abc-98bc-5ef59e97ef9b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.540s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:06:38 user nova-compute[75233]: INFO nova.compute.manager [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] instance snapshotting
Dec 05 14:06:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Beginning live snapshot process
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json -f qcow2 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphgnd9v_4/8109f6fa97be45cfaccbbc7493443399.delta 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphgnd9v_4/8109f6fa97be45cfaccbbc7493443399.delta 1073741824" returned: 0 in 0.055s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:38 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 14:06:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 14:06:39 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75233) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 14:06:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 14:06:40 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:06:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphgnd9v_4/8109f6fa97be45cfaccbbc7493443399.delta /opt/stack/data/nova/instances/snapshots/tmphgnd9v_4/8109f6fa97be45cfaccbbc7493443399 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphgnd9v_4/8109f6fa97be45cfaccbbc7493443399.delta /opt/stack/data/nova/instances/snapshots/tmphgnd9v_4/8109f6fa97be45cfaccbbc7493443399" returned: 0 in 0.271s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Snapshot extracted, beginning image upload
Dec 05 14:06:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Snapshot image upload complete
Dec 05 14:06:42 user nova-compute[75233]: INFO nova.compute.manager [None req-93e689f0-ca59-4864-aa19-626d1d6f0c5b tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Took 4.86 seconds to snapshot the instance on the hypervisor.
Dec 05 14:06:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:44 user nova-compute[75233]: INFO nova.compute.manager [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Terminating instance
Dec 05 14:06:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:44 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:06:44 user nova-compute[75233]: INFO nova.compute.claims [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Claim successful on node user
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-1dd7f1a8-9857-4945-9fcf-1c60b5793553 req-b0399d89-b597-471a-844c-1226361db17f service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1dd7f1a8-9857-4945-9fcf-1c60b5793553 req-b0399d89-b597-471a-844c-1226361db17f service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1dd7f1a8-9857-4945-9fcf-1c60b5793553 req-b0399d89-b597-471a-844c-1226361db17f service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1dd7f1a8-9857-4945-9fcf-1c60b5793553 req-b0399d89-b597-471a-844c-1226361db17f service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-1dd7f1a8-9857-4945-9fcf-1c60b5793553 req-b0399d89-b597-471a-844c-1226361db17f service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-1dd7f1a8-9857-4945-9fcf-1c60b5793553 req-b0399d89-b597-471a-844c-1226361db17f service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-unplugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:06:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.policy [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1250912fa96345cc8b33124bc57e5a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08fec6162ff24a32872749d6da8cba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:06:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Instance destroyed successfully.
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.objects.instance [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'resources' on Instance uuid 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:06:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Creating image(s)
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "/opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "/opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1201397284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1201397284',id=38,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:03:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-s03pug3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:04:59Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=5d7dcc32-4c98-49c0-83de-edfb17fde4f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "address": "fa:16:3e:57:08:fb", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dac7c05-94", "ovs_interfaceid": "9dac7c05-94b6-42d9-80d2-4aea62f417c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_vif [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dac7c05-94, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=362bad23-7027-424a-a49d-3d77271ba3f6) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:45 user nova-compute[75233]: INFO os_vif [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:08:fb,bridge_name='br-int',has_traffic_filtering=True,id=9dac7c05-94b6-42d9-80d2-4aea62f417c2,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dac7c05-94')
Dec 05 14:06:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPTeZsYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:06:45 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae43700-da6b-47c9-ad1e-79dfd5455a5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:06:45 user nova-compute[75233]: No targets found.
Dec 05 14:06:45 user nova-compute[75233]: iSNS:
Dec 05 14:06:45 user nova-compute[75233]: No targets found.
Dec 05 14:06:45 user nova-compute[75233]: STATIC:
Dec 05 14:06:45 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 14:06:45 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:45 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:45 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361
Dec 05 14:06:45 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:45 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:45 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60
Dec 05 14:06:45 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:06:45 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:06:45 user nova-compute[75233]: FIRMWARE:
Dec 05 14:06:45 user nova-compute[75233]: No targets found.
Dec 05 14:06:45 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:06:45 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:06:45 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:06:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d518e8-b6eb-424b-a546-1f76ae03df95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f368515e-6fe9-4866-b2d5-8a387ae6d8a2]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:46 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:46 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:06:46 user nova-compute[75233]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 (non-flash)
Dec 05 14:06:46 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:06:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f61496830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676c408-8ecd-431f-89c3-2c13086fbe4a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4840ed6-1b36-4354-8345-4159ddde433f]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c7417-fb47-40b0-8a47-c3dddcc460b8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG nova.virt.images [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] e39311d8-12f5-4dd5-b13d-b24898ff150f was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.part /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.086s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb53f8e-b8ca-4bc5-b775-e7176dacce22]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35c33ef-ff5e-416b-b97d-d24ccf2fcb5d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6af089-e4ea-4185-862f-0626a509a831]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260]
Dec 05 14:06:46 user nova-compute[75233]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60, portal: 172.16.0.220,3260] successful.
Dec 05 14:06:46 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda0c10d-dba4-4a3d-a318-5d85636a6b60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590ef3e-340a-4214-acc1-f15ff0c777a6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.093s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== disconnect_volume: return (1095ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:06:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Deleting instance files /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2_del
Dec 05 14:06:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Deletion of /opt/stack/data/nova/instances/5d7dcc32-4c98-49c0-83de-edfb17fde4f2_del complete
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.part /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.converted" returned: 0 in 0.222s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:46 user nova-compute[75233]: INFO nova.compute.manager [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Took 2.04 seconds to destroy the instance on the hypervisor.
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.406s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Successfully created port: 7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 --force-share --output=json" returned: 0 in 0.227s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc7bd7e6-fc4c-4d00-8d33-f6af60e323c5 req-9648c5fe-a106-4c33-8d14-76e56283725e service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc7bd7e6-fc4c-4d00-8d33-f6af60e323c5 req-9648c5fe-a106-4c33-8d14-76e56283725e service nova] Acquiring lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc7bd7e6-fc4c-4d00-8d33-f6af60e323c5 req-9648c5fe-a106-4c33-8d14-76e56283725e service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.015s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc7bd7e6-fc4c-4d00-8d33-f6af60e323c5 req-9648c5fe-a106-4c33-8d14-76e56283725e service nova] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc7bd7e6-fc4c-4d00-8d33-f6af60e323c5 req-9648c5fe-a106-4c33-8d14-76e56283725e service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] No waiting events found dispatching network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:47 user nova-compute[75233]: WARNING nova.compute.manager [req-dc7bd7e6-fc4c-4d00-8d33-f6af60e323c5 req-9648c5fe-a106-4c33-8d14-76e56283725e service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received unexpected event network-vif-plugged-9dac7c05-94b6-42d9-80d2-4aea62f417c2 for instance with vm_state active and task_state deleting.
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 --force-share --output=json" returned: 0 in 0.215s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4,backing_fmt=raw /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-9be2cefb-3b2e-4729-b4b7-9c4c3e50d16d req-0a1fdee5-d2a5-41ac-ba56-710378dd3f45 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Received event network-vif-deleted-9dac7c05-94b6-42d9-80d2-4aea62f417c2 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:47 user nova-compute[75233]: INFO nova.compute.manager [req-9be2cefb-3b2e-4729-b4b7-9c4c3e50d16d req-0a1fdee5-d2a5-41ac-ba56-710378dd3f45 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Neutron deleted interface 9dac7c05-94b6-42d9-80d2-4aea62f417c2; detaching it from the instance and deleting it from the info cache
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.network.neutron [req-9be2cefb-3b2e-4729-b4b7-9c4c3e50d16d req-0a1fdee5-d2a5-41ac-ba56-710378dd3f45 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:47 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Took 1.01 seconds to deallocate network for instance.
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4,backing_fmt=raw /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk 1073741824" returned: 0 in 0.412s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.634s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:06:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-9be2cefb-3b2e-4729-b4b7-9c4c3e50d16d req-0a1fdee5-d2a5-41ac-ba56-710378dd3f45 service nova] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Detach interface failed, port_id=9dac7c05-94b6-42d9-80d2-4aea62f417c2, reason: Instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Ensure instance console log exists: /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Successfully updated port: 7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquired lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-changed-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Refreshing instance network info cache due to event network-changed-7e3df363-0dfb-47e1-9e7f-5ac627dff59a. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] Acquiring lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating instance_info_cache with network_info: [{"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Releasing lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Instance network_info: |[{"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] Acquired lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Refreshing network info cache for port 7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Start _get_guest_xml network_info=[{"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3810a13d84bdc870da0c5e095bad8e28',container_format='bare',created_at=2023-12-05T14:06:38Z,direct_url=<?>,disk_format='qcow2',id=e39311d8-12f5-4dd5-b13d-b24898ff150f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1871565271',owner='08fec6162ff24a32872749d6da8cba62',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T14:06:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'e39311d8-12f5-4dd5-b13d-b24898ff150f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:06:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:06:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3810a13d84bdc870da0c5e095bad8e28',container_format='bare',created_at=2023-12-05T14:06:38Z,direct_url=<?>,disk_format='qcow2',id=e39311d8-12f5-4dd5-b13d-b24898ff150f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1871565271',owner='08fec6162ff24a32872749d6da8cba62',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T14:06:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2128918561',display_name='tempest-TestStampPattern-server-2128918561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2128918561',id=42,image_ref='e39311d8-12f5-4dd5-b13d-b24898ff150f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIedrrr5CE8wjPd1SkAUTBltBGqS1dEEAtKuYjsNtuqZmT4zwIJLInTE1TYClnheTxTqpcj8MCv2abVGlc40j1ekh9WoFXKSYiBc/BClcwOcdjLtjTZMB8WsYkVzRpRPg==',key_name='tempest-TestStampPattern-1706655752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08fec6162ff24a32872749d6da8cba62',ramdisk_id='',reservation_id='r-68xqqe8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9',image_min_disk='1',image_min_ram='0',image_owner_id='08fec6162ff24a32872749d6da8cba62',image_owner_project_name='tempest-TestStampPattern-1121995077',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1121995077-project-member',image_user_id='1250912fa96345cc8b33124bc57e5a66',network_allocated='True',owner_project_name='tempest-TestStampPattern-1121995077',owner_user_name='tempest-TestStampPattern-1121995077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:06:45Z,user_data=None,user_id='1250912fa96345cc8b33124bc57e5a66',uuid=f7877f1b-b2c4-4ba7-84a6-28a8f71f3368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converting VIF {"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'pci_devices' on Instance uuid f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:06:48 user nova-compute[75233]:   <uuid>f7877f1b-b2c4-4ba7-84a6-28a8f71f3368</uuid>
Dec 05 14:06:48 user nova-compute[75233]:   <name>instance-0000002a</name>
Dec 05 14:06:48 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:06:48 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:06:48 user nova-compute[75233]:   <metadata>
Dec 05 14:06:48 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:06:48 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:06:48 user nova-compute[75233]:       <nova:name>tempest-TestStampPattern-server-2128918561</nova:name>
Dec 05 14:06:48 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:06:48</nova:creationTime>
Dec 05 14:06:48 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:06:48 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:06:48 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:06:48 user nova-compute[75233]:       <nova:owner>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:user uuid="1250912fa96345cc8b33124bc57e5a66">tempest-TestStampPattern-1121995077-project-member</nova:user>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:project uuid="08fec6162ff24a32872749d6da8cba62">tempest-TestStampPattern-1121995077</nova:project>
Dec 05 14:06:48 user nova-compute[75233]:       </nova:owner>
Dec 05 14:06:48 user nova-compute[75233]:       <nova:root type="image" uuid="e39311d8-12f5-4dd5-b13d-b24898ff150f"/>
Dec 05 14:06:48 user nova-compute[75233]:       <nova:ports>
Dec 05 14:06:48 user nova-compute[75233]:         <nova:port uuid="7e3df363-0dfb-47e1-9e7f-5ac627dff59a">
Dec 05 14:06:48 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 14:06:48 user nova-compute[75233]:         </nova:port>
Dec 05 14:06:48 user nova-compute[75233]:       </nova:ports>
Dec 05 14:06:48 user nova-compute[75233]:     </nova:instance>
Dec 05 14:06:48 user nova-compute[75233]:   </metadata>
Dec 05 14:06:48 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:06:48 user nova-compute[75233]:     <system>
Dec 05 14:06:48 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:06:48 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:06:48 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:06:48 user nova-compute[75233]:       <entry name="serial">f7877f1b-b2c4-4ba7-84a6-28a8f71f3368</entry>
Dec 05 14:06:48 user nova-compute[75233]:       <entry name="uuid">f7877f1b-b2c4-4ba7-84a6-28a8f71f3368</entry>
Dec 05 14:06:48 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:06:48 user nova-compute[75233]:     </system>
Dec 05 14:06:48 user nova-compute[75233]:   </sysinfo>
Dec 05 14:06:48 user nova-compute[75233]:   <os>
Dec 05 14:06:48 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:06:48 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:06:48 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:06:48 user nova-compute[75233]:   </os>
Dec 05 14:06:48 user nova-compute[75233]:   <features>
Dec 05 14:06:48 user nova-compute[75233]:     <acpi/>
Dec 05 14:06:48 user nova-compute[75233]:     <apic/>
Dec 05 14:06:48 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:06:48 user nova-compute[75233]:   </features>
Dec 05 14:06:48 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:06:48 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:06:48 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:06:48 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:06:48 user nova-compute[75233]:   </clock>
Dec 05 14:06:48 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:06:48 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:06:48 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:06:48 user nova-compute[75233]:   </cpu>
Dec 05 14:06:48 user nova-compute[75233]:   <devices>
Dec 05 14:06:48 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:06:48 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:06:48 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk"/>
Dec 05 14:06:48 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:06:48 user nova-compute[75233]:     </disk>
Dec 05 14:06:48 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:06:48 user nova-compute[75233]:       <mac address="fa:16:3e:7a:af:33"/>
Dec 05 14:06:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:06:48 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:06:48 user nova-compute[75233]:       <target dev="tap7e3df363-0d"/>
Dec 05 14:06:48 user nova-compute[75233]:     </interface>
Dec 05 14:06:48 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:06:48 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/console.log" append="off"/>
Dec 05 14:06:48 user nova-compute[75233]:     </serial>
Dec 05 14:06:48 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:06:48 user nova-compute[75233]:     <video>
Dec 05 14:06:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:06:48 user nova-compute[75233]:     </video>
Dec 05 14:06:48 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:06:48 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:06:48 user nova-compute[75233]:     </rng>
Dec 05 14:06:48 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:06:48 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:06:48 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:06:48 user nova-compute[75233]:     </memballoon>
Dec 05 14:06:48 user nova-compute[75233]:   </devices>
Dec 05 14:06:48 user nova-compute[75233]: </domain>
Dec 05 14:06:48 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2128918561',display_name='tempest-TestStampPattern-server-2128918561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2128918561',id=42,image_ref='e39311d8-12f5-4dd5-b13d-b24898ff150f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIedrrr5CE8wjPd1SkAUTBltBGqS1dEEAtKuYjsNtuqZmT4zwIJLInTE1TYClnheTxTqpcj8MCv2abVGlc40j1ekh9WoFXKSYiBc/BClcwOcdjLtjTZMB8WsYkVzRpRPg==',key_name='tempest-TestStampPattern-1706655752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08fec6162ff24a32872749d6da8cba62',ramdisk_id='',reservation_id='r-68xqqe8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9',image_min_disk='1',image_min_ram='0',image_owner_id='08fec6162ff24a32872749d6da8cba62',image_owner_project_name='tempest-TestStampPattern-1121995077',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1121995077-project-member',image_user_id='1250912fa96345cc8b33124bc57e5a66',network_allocated='True',owner_project_name='tempest-TestStampPattern-1121995077',owner_user_name='tempest-TestStampPattern-1121995077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:06:45Z,user_data=None,user_id='1250912fa96345cc8b33124bc57e5a66',uuid=f7877f1b-b2c4-4ba7-84a6-28a8f71f3368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converting VIF {"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG os_vif [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fba485a5-a170-5c3f-b786-ca76b71d3032', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e3df363-0d, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e3df363-0d, col_values=(('qos', UUID('29c757f3-fcdd-4d05-ad31-bd0e8b536c30')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e3df363-0d, col_values=(('external_ids', {'iface-id': '7e3df363-0dfb-47e1-9e7f-5ac627dff59a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:af:33', 'vm-uuid': 'f7877f1b-b2c4-4ba7-84a6-28a8f71f3368'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:48 user nova-compute[75233]: INFO os_vif [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d')
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No VIF found with MAC fa:16:3e:7a:af:33, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:06:48 user nova-compute[75233]: INFO nova.compute.manager [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 5d7dcc32-4c98-49c0-83de-edfb17fde4f2] Took 0.80 seconds to detach 1 volumes for instance.
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updated VIF entry in instance network info cache for port 7e3df363-0dfb-47e1-9e7f-5ac627dff59a. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating instance_info_cache with network_info: [{"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7661354d-3739-44b4-9251-53428d575031 req-53cbd0bf-656a-4883-a5da-90dfe993b508 service nova] Releasing lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:06:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:48 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Deleted allocations for instance 5d7dcc32-4c98-49c0-83de-edfb17fde4f2
Dec 05 14:06:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-9b2c3e3d-5685-4fcf-a8e2-fd5d195aef25 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "5d7dcc32-4c98-49c0-83de-edfb17fde4f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.283s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ab7b344-0e11-49f3-8921-ed3b227b4a5d req-9ed6e6a5-3b0a-4bf5-833d-45ce33a59ca9 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ab7b344-0e11-49f3-8921-ed3b227b4a5d req-9ed6e6a5-3b0a-4bf5-833d-45ce33a59ca9 service nova] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ab7b344-0e11-49f3-8921-ed3b227b4a5d req-9ed6e6a5-3b0a-4bf5-833d-45ce33a59ca9 service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2ab7b344-0e11-49f3-8921-ed3b227b4a5d req-9ed6e6a5-3b0a-4bf5-833d-45ce33a59ca9 service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-2ab7b344-0e11-49f3-8921-ed3b227b4a5d req-9ed6e6a5-3b0a-4bf5-833d-45ce33a59ca9 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] No waiting events found dispatching network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:50 user nova-compute[75233]: WARNING nova.compute.manager [req-2ab7b344-0e11-49f3-8921-ed3b227b4a5d req-9ed6e6a5-3b0a-4bf5-833d-45ce33a59ca9 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received unexpected event network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a for instance with vm_state building and task_state spawning.
Dec 05 14:06:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:06:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:06:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Instance spawned successfully.
Dec 05 14:06:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:06:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:06:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:06:52 user nova-compute[75233]: INFO nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Took 6.49 seconds to spawn the instance on the hypervisor.
Dec 05 14:06:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:06:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-384daf27-bf49-4db8-b1ac-330c70adbdad req-6cf032bf-1c8b-4ea9-9a83-7c06fe013f81 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:06:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-384daf27-bf49-4db8-b1ac-330c70adbdad req-6cf032bf-1c8b-4ea9-9a83-7c06fe013f81 service nova] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:06:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-384daf27-bf49-4db8-b1ac-330c70adbdad req-6cf032bf-1c8b-4ea9-9a83-7c06fe013f81 service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:06:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-384daf27-bf49-4db8-b1ac-330c70adbdad req-6cf032bf-1c8b-4ea9-9a83-7c06fe013f81 service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-384daf27-bf49-4db8-b1ac-330c70adbdad req-6cf032bf-1c8b-4ea9-9a83-7c06fe013f81 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] No waiting events found dispatching network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:06:52 user nova-compute[75233]: WARNING nova.compute.manager [req-384daf27-bf49-4db8-b1ac-330c70adbdad req-6cf032bf-1c8b-4ea9-9a83-7c06fe013f81 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received unexpected event network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a for instance with vm_state building and task_state spawning.
Dec 05 14:06:52 user nova-compute[75233]: INFO nova.compute.manager [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Took 7.32 seconds to build instance.
Dec 05 14:06:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42951431-1f3d-493b-ad6f-6429a086a4e0 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.416s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:06:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:06:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:06:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:07:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:07:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:07:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8277MB free_disk=24.569538116455078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bdded23f-3fff-443e-af17-90145e598f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 067d8f98-27bb-4060-a03d-523eca3b15b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:07:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 3f5b5067-5f96-48a8-a6da-7630b1a972d6 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:07:19 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [{"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:07:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-3f5b5067-5f96-48a8-a6da-7630b1a972d6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:07:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:07:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:07:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "bdded23f-3fff-443e-af17-90145e598f9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:35 user nova-compute[75233]: INFO nova.compute.manager [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Terminating instance
Dec 05 14:07:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc26739d-0e6e-4845-9019-9986e88e04ba req-4062150c-ccc2-4835-a5bf-e844b00fa8bf service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-vif-unplugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc26739d-0e6e-4845-9019-9986e88e04ba req-4062150c-ccc2-4835-a5bf-e844b00fa8bf service nova] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc26739d-0e6e-4845-9019-9986e88e04ba req-4062150c-ccc2-4835-a5bf-e844b00fa8bf service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dc26739d-0e6e-4845-9019-9986e88e04ba req-4062150c-ccc2-4835-a5bf-e844b00fa8bf service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc26739d-0e6e-4845-9019-9986e88e04ba req-4062150c-ccc2-4835-a5bf-e844b00fa8bf service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] No waiting events found dispatching network-vif-unplugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-dc26739d-0e6e-4845-9019-9986e88e04ba req-4062150c-ccc2-4835-a5bf-e844b00fa8bf service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-vif-unplugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Instance destroyed successfully.
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'resources' on Instance uuid bdded23f-3fff-443e-af17-90145e598f9e {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334555445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334555445',id=37,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-pb500caa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:00:09Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=bdded23f-3fff-443e-af17-90145e598f9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "address": "fa:16:3e:80:b5:c7", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07c77e5-9e", "ovs_interfaceid": "e07c77e5-9e0e-4e4a-a575-84eba30c9168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG os_vif [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape07c77e5-9e, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa53437f-9c0a-492e-8ee8-872300d51e16) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:36 user nova-compute[75233]: INFO os_vif [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:b5:c7,bridge_name='br-int',has_traffic_filtering=True,id=e07c77e5-9e0e-4e4a-a575-84eba30c9168,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07c77e5-9e')
Dec 05 14:07:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Deleting instance files /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e_del
Dec 05 14:07:36 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Deletion of /opt/stack/data/nova/instances/bdded23f-3fff-443e-af17-90145e598f9e_del complete
Dec 05 14:07:36 user nova-compute[75233]: INFO nova.compute.manager [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 05 14:07:36 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: bdded23f-3fff-443e-af17-90145e598f9e] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:07:36 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Took 0.45 seconds to deallocate network for instance.
Dec 05 14:07:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:37 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Deleted allocations for instance bdded23f-3fff-443e-af17-90145e598f9e
Dec 05 14:07:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6c6896bb-6b6a-460a-be44-0f6518435e3f tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "bdded23f-3fff-443e-af17-90145e598f9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.569s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] Acquiring lock "bdded23f-3fff-443e-af17-90145e598f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] Lock "bdded23f-3fff-443e-af17-90145e598f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:07:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] No waiting events found dispatching network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:07:37 user nova-compute[75233]: WARNING nova.compute.manager [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received unexpected event network-vif-plugged-e07c77e5-9e0e-4e4a-a575-84eba30c9168 for instance with vm_state deleted and task_state None.
Dec 05 14:07:37 user nova-compute[75233]: DEBUG nova.compute.manager [req-437e237a-453c-4a59-9fc9-af1481579db3 req-05a715ee-6943-4512-8614-ed21bf13027d service nova] [instance: bdded23f-3fff-443e-af17-90145e598f9e] Received event network-vif-deleted-e07c77e5-9e0e-4e4a-a575-84eba30c9168 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:07:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:07:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:07:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:07:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:07:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:07:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:00 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:05 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-changed-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing instance network info cache due to event network-changed-f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing network info cache for port f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updated VIF entry in instance network info cache for port f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-82e142db-9a10-4964-b9d2-1ed2f1c408e3 req-ac888161-98bf-43bd-b473-b6df70a74271 service nova] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-changed-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing instance network info cache due to event network-changed-f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] Acquiring lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] Acquired lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Refreshing network info cache for port f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:08:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:08:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=24.685882568359375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:07 user nova-compute[75233]: INFO nova.compute.manager [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Detaching volume fe5d7ec7-2c2c-4453-afc6-0171fa79d361
Dec 05 14:08:07 user nova-compute[75233]: INFO nova.virt.block_device [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Attempting to driver detach volume fe5d7ec7-2c2c-4453-afc6-0171fa79d361 from mountpoint /dev/vdb
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ab4d6587-2b04-46f7-9756-223a264a3efa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 067d8f98-27bb-4060-a03d-523eca3b15b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Attempting to detach device vdb from instance 067d8f98-27bb-4060-a03d-523eca3b15b0 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:08:07 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:08:07 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:08:07 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:08:07 user nova-compute[75233]:   <serial>fe5d7ec7-2c2c-4453-afc6-0171fa79d361</serial>
Dec 05 14:08:07 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 14:08:07 user nova-compute[75233]: </disk>
Dec 05 14:08:07 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:08:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully detached device vdb from instance 067d8f98-27bb-4060-a03d-523eca3b15b0 from the persistent domain config.
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 067d8f98-27bb-4060-a03d-523eca3b15b0 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:08:07 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:08:07 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:08:07 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:08:07 user nova-compute[75233]:   <serial>fe5d7ec7-2c2c-4453-afc6-0171fa79d361</serial>
Dec 05 14:08:07 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 14:08:07 user nova-compute[75233]: </disk>
Dec 05 14:08:07 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:08:07 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:08:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:08:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updated VIF entry in instance network info cache for port f8f03810-26d5-4443-9557-35623e658ffc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:08:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [{"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-40437f3b-d7fe-43d2-bf2c-80a1c94df749 req-621fc574-ef30-4108-9e60-70cc9054bbc7 service nova] Releasing lock "refresh_cache-067d8f98-27bb-4060-a03d-523eca3b15b0" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:08:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:08:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:09 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:08:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:09 user nova-compute[75233]: INFO nova.compute.manager [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Unshelving
Dec 05 14:08:10 user nova-compute[75233]: INFO nova.virt.block_device [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Booting with volume c15a3602-2ebb-4c08-b84e-befec193a20f at /dev/vdc
Dec 05 14:08:10 user nova-compute[75233]: DEBUG os_brick.utils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[72281034-5095-4ba5-9251-43c79e401c1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcca0af-2cbc-42ca-8764-e481439b3824]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd50ae7f-3274-47ea-a738-1d4faeba0bff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606f040-4386-423f-927c-b44897655d53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:08:10 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9186235-790c-460d-adc6-27ee81b02578]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG os_brick.utils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating existing volume attachment record: 338a9562-fa33-43bc-8600-49e61814bf01 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:08:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:08:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:08:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:08:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'pci_requests' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'numa_topology' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:08:19 user nova-compute[75233]: INFO nova.compute.claims [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Claim successful on node user
Dec 05 14:08:19 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:08:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:20 user nova-compute[75233]: INFO nova.network.neutron [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquired lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-changed-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG nova.compute.manager [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Refreshing instance network info cache due to event network-changed-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:08:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] Acquiring lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [{"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.network.neutron [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-ab4d6587-2b04-46f7-9756-223a264a3efa" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Releasing lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:08:21 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Creating image(s)
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] Acquired lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.network.neutron [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Refreshing network info cache for port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG nova.objects.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<ce34db0a-bdc8-4379-8987-1ed437357311> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "4147269ee60a4b87fad1d18b7d4342d3f0507ce7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "4147269ee60a4b87fad1d18b7d4342d3f0507ce7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG nova.virt.images [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] 511be692-f34a-4274-a79b-986c5b9a88f9 was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.part /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.part /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.converted" returned: 0 in 0.344s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updated VIF entry in instance network info cache for port ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG nova.network.neutron [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4e4e71e3-5056-42c4-a9f2-c6fc7952ac22 req-da681ff5-1775-4bdc-8e95-d1eb88dccb6b service nova] Releasing lock "refresh_cache-ce34db0a-bdc8-4379-8987-1ed437357311" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "4147269ee60a4b87fad1d18b7d4342d3f0507ce7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.916s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7 --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "4147269ee60a4b87fad1d18b7d4342d3f0507ce7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "4147269ee60a4b87fad1d18b7d4342d3f0507ce7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7 --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7,backing_fmt=raw /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7,backing_fmt=raw /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk 1073741824" returned: 0 in 0.048s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "4147269ee60a4b87fad1d18b7d4342d3f0507ce7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7 --force-share --output=json" returned: 0 in 0.167s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'migration_context' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG nova.objects.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<ce34db0a-bdc8-4379-8987-1ed437357311> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:08:23 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Rebasing disk image.
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.193s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec -F raw /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec -F raw /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk" returned: 0 in 1.883s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Ensure instance console log exists: /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Start _get_guest_xml network_info=[{"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a9579430a346dd914df9243de1d63a24',container_format='bare',created_at=2023-12-05T14:06:18Z,direct_url=<?>,disk_format='qcow2',id=511be692-f34a-4274-a79b-986c5b9a88f9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1899445961-shelved',owner='536eea64226a4234a4603ba5cf20cf1c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T14:06:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUYnMDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ce34db0a-bdc8-4379-8987-1ed437357311', 'attached_at': '', 'detached_at': '', 'volume_id': 'c15a3602-2ebb-4c08-b84e-befec193a20f', 'serial': 'c15a3602-2ebb-4c08-b84e-befec193a20f'}, 'delete_on_termination': False, 'attachment_id': '338a9562-fa33-43bc-8600-49e61814bf01', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:08:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:08:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a9579430a346dd914df9243de1d63a24',container_format='bare',created_at=2023-12-05T14:06:18Z,direct_url=<?>,disk_format='qcow2',id=511be692-f34a-4274-a79b-986c5b9a88f9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1899445961-shelved',owner='536eea64226a4234a4603ba5cf20cf1c',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T14:06:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.objects.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<ce34db0a-bdc8-4379-8987-1ed437357311> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUYnMDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:08:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:08:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:08:25 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdea62-c153-470a-aa13-27810d99bd58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:08:25 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf8976d-0c91-4079-a8a6-22a69ee31939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f] added
Dec 05 14:08:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef79c7d-93eb-4d72-ac54-e2dc46adef8d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5195284e-d1c2-44de-806a-54dfadac29c5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUYnMDk {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUYnMDk" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c188f8-7177-40e3-b17c-638aedf5a921]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKUYnMDk'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc324cc-b31b-4bed-82a0-7a2ad29b41cf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86801b1-da56-490f-b318-f644d5f6b100]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:08:26 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:08:26 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:26 user nova-compute[75233]: INFO nova.compute.manager [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Terminating instance
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da173d8-c326-4b18-b06e-8d6ef80e81f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260]
Dec 05 14:08:26 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260] successful.
Dec 05 14:08:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efcd80f-a2f6-4d4f-83c4-be2c0e40bb0e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c302142b-86ad-40c5-ba6c-8e9b86d32a2f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:08:26 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:26 user nova-compute[75233]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:08:26 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:26 user nova-compute[75233]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d7da5-c10f-4b6a-bff4-84d94ba257e9]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-745e9fda-779c-4a0b-a7fd-58e75255b247 req-30b26cac-7785-4b77-a8f1-bf29eae1a7a9 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-745e9fda-779c-4a0b-a7fd-58e75255b247 req-30b26cac-7785-4b77-a8f1-bf29eae1a7a9 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-745e9fda-779c-4a0b-a7fd-58e75255b247 req-30b26cac-7785-4b77-a8f1-bf29eae1a7a9 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-745e9fda-779c-4a0b-a7fd-58e75255b247 req-30b26cac-7785-4b77-a8f1-bf29eae1a7a9 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-745e9fda-779c-4a0b-a7fd-58e75255b247 req-30b26cac-7785-4b77-a8f1-bf29eae1a7a9 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-745e9fda-779c-4a0b-a7fd-58e75255b247 req-30b26cac-7785-4b77-a8f1-bf29eae1a7a9 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-unplugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Instance destroyed successfully.
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'resources' on Instance uuid ab4d6587-2b04-46f7-9756-223a264a3efa {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:52:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1556427376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1556427376',id=28,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-4tgm05pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:56:25Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=ab4d6587-2b04-46f7-9756-223a264a3efa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "8cc45a19-cc12-4332-8254-0d66824372ad", "address": "fa:16:3e:05:09:96", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc45a19-cc", "ovs_interfaceid": "8cc45a19-cc12-4332-8254-0d66824372ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_vif [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cc45a19-cc, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6b6d85a-8d50-4739-a730-79adac4973bc) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:08:26 user nova-compute[75233]: INFO os_vif [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:09:96,bridge_name='br-int',has_traffic_filtering=True,id=8cc45a19-cc12-4332-8254-0d66824372ad,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc45a19-cc')
Dec 05 14:08:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKItQhbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:08:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:08:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUYnMDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26137386266313662', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137386266313662', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.278s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee5dca-efb0-4b0a-8c03-a28a72d4cda8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:08:27 user nova-compute[75233]: No targets found.
Dec 05 14:08:27 user nova-compute[75233]: iSNS:
Dec 05 14:08:27 user nova-compute[75233]: No targets found.
Dec 05 14:08:27 user nova-compute[75233]: STATIC:
Dec 05 14:08:27 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac
Dec 05 14:08:27 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:08:27 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:08:27 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f
Dec 05 14:08:27 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:08:27 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:08:27 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361
Dec 05 14:08:27 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:08:27 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:08:27 user nova-compute[75233]: FIRMWARE:
Dec 05 14:08:27 user nova-compute[75233]: No targets found.
Dec 05 14:08:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:08:27 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:08:27 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T14:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1899445961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1899445961',id=41,image_ref='511be692-f34a-4274-a79b-986c5b9a88f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1905971800',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-iron191t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member',shelved_at='2023-12-05T14:06:21.962003',shelved_host='user',shelved_image_id='511be692-f34a-4274-a79b-986c5b9a88f9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=ce34db0a-bdc8-4379-8987-1ed437357311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'pci_devices' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1cdd62-07e1-4e44-9433-01e8fa94ba3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.objects.base [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<ce34db0a-bdc8-4379-8987-1ed437357311> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:08:27 user nova-compute[75233]:   <uuid>ce34db0a-bdc8-4379-8987-1ed437357311</uuid>
Dec 05 14:08:27 user nova-compute[75233]:   <name>instance-00000029</name>
Dec 05 14:08:27 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:08:27 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:08:27 user nova-compute[75233]:   <metadata>
Dec 05 14:08:27 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:08:27 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:08:27 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1899445961</nova:name>
Dec 05 14:08:27 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:08:25</nova:creationTime>
Dec 05 14:08:27 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:08:27 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:08:27 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:08:27 user nova-compute[75233]:       <nova:owner>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:user uuid="317f3e447b58464eb428e63ac23f80c6">tempest-AttachVolumeShelveTestJSON-1457724058-project-member</nova:user>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:project uuid="536eea64226a4234a4603ba5cf20cf1c">tempest-AttachVolumeShelveTestJSON-1457724058</nova:project>
Dec 05 14:08:27 user nova-compute[75233]:       </nova:owner>
Dec 05 14:08:27 user nova-compute[75233]:       <nova:root type="image" uuid="511be692-f34a-4274-a79b-986c5b9a88f9"/>
Dec 05 14:08:27 user nova-compute[75233]:       <nova:ports>
Dec 05 14:08:27 user nova-compute[75233]:         <nova:port uuid="ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e">
Dec 05 14:08:27 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 14:08:27 user nova-compute[75233]:         </nova:port>
Dec 05 14:08:27 user nova-compute[75233]:       </nova:ports>
Dec 05 14:08:27 user nova-compute[75233]:     </nova:instance>
Dec 05 14:08:27 user nova-compute[75233]:   </metadata>
Dec 05 14:08:27 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:08:27 user nova-compute[75233]:     <system>
Dec 05 14:08:27 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:08:27 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:08:27 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:08:27 user nova-compute[75233]:       <entry name="serial">ce34db0a-bdc8-4379-8987-1ed437357311</entry>
Dec 05 14:08:27 user nova-compute[75233]:       <entry name="uuid">ce34db0a-bdc8-4379-8987-1ed437357311</entry>
Dec 05 14:08:27 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:08:27 user nova-compute[75233]:     </system>
Dec 05 14:08:27 user nova-compute[75233]:   </sysinfo>
Dec 05 14:08:27 user nova-compute[75233]:   <os>
Dec 05 14:08:27 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:08:27 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:08:27 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:08:27 user nova-compute[75233]:   </os>
Dec 05 14:08:27 user nova-compute[75233]:   <features>
Dec 05 14:08:27 user nova-compute[75233]:     <acpi/>
Dec 05 14:08:27 user nova-compute[75233]:     <apic/>
Dec 05 14:08:27 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:08:27 user nova-compute[75233]:   </features>
Dec 05 14:08:27 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:08:27 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:08:27 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:08:27 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:08:27 user nova-compute[75233]:   </clock>
Dec 05 14:08:27 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:08:27 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:08:27 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:08:27 user nova-compute[75233]:   </cpu>
Dec 05 14:08:27 user nova-compute[75233]:   <devices>
Dec 05 14:08:27 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:08:27 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:08:27 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk"/>
Dec 05 14:08:27 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:08:27 user nova-compute[75233]:     </disk>
Dec 05 14:08:27 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:08:27 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:08:27 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 14:08:27 user nova-compute[75233]:       <target dev="vdc" bus="virtio"/>
Dec 05 14:08:27 user nova-compute[75233]:       <serial>c15a3602-2ebb-4c08-b84e-befec193a20f</serial>
Dec 05 14:08:27 user nova-compute[75233]:     </disk>
Dec 05 14:08:27 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:08:27 user nova-compute[75233]:       <mac address="fa:16:3e:0c:58:cd"/>
Dec 05 14:08:27 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:08:27 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:08:27 user nova-compute[75233]:       <target dev="tapffe999fc-54"/>
Dec 05 14:08:27 user nova-compute[75233]:     </interface>
Dec 05 14:08:27 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:08:27 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/console.log" append="off"/>
Dec 05 14:08:27 user nova-compute[75233]:     </serial>
Dec 05 14:08:27 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:08:27 user nova-compute[75233]:     <video>
Dec 05 14:08:27 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:08:27 user nova-compute[75233]:     </video>
Dec 05 14:08:27 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:08:27 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:08:27 user nova-compute[75233]:     </rng>
Dec 05 14:08:27 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:08:27 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:08:27 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:08:27 user nova-compute[75233]:     </memballoon>
Dec 05 14:08:27 user nova-compute[75233]:   </devices>
Dec 05 14:08:27 user nova-compute[75233]: </domain>
Dec 05 14:08:27 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T14:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1899445961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1899445961',id=41,image_ref='511be692-f34a-4274-a79b-986c5b9a88f9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1905971800',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-iron191t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member',shelved_at='2023-12-05T14:06:21.962003',shelved_host='user',shelved_image_id='511be692-f34a-4274-a79b-986c5b9a88f9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=ce34db0a-bdc8-4379-8987-1ed437357311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_vif [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60ce6647-8183-51d3-8f43-5f0c7f4a736d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef2c8a1-698f-4185-972b-380b681d9b23]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:08:27 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:27 user nova-compute[75233]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac (non-flash)
Dec 05 14:08:27 user nova-compute[75233]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:27 user nova-compute[75233]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f345372e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac'): ({'sde'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Removing single pathed devices sde {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffe999fc-54, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffe999fc-54, col_values=(('qos', UUID('c62ef4f3-a008-416c-b64f-51d96fd89335')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffe999fc-54, col_values=(('external_ids', {'iface-id': 'ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:58:cd', 'vm-uuid': 'ce34db0a-bdc8-4379-8987-1ed437357311'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: INFO os_vif [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54')
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95612d33-f17d-4688-8e8f-74b2c2556a8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[44565e76-51d8-43eb-be6c-8f04d9f95aea]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Flushing IO for device /dev/sde {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d04c0a9-23e5-440f-824d-ec8bf70e159b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No VIF found with MAC fa:16:3e:0c:58:cd, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d226aee2-1535-4207-9aaa-1309909f37d0]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] SCSI volumes sde have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ffc25-ace9-4086-8801-0a223a990d2a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b1ef0-e0d6-4985-a35e-323d1be63373]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260]
Dec 05 14:08:27 user nova-compute[75233]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac, portal: 172.16.0.220,3260] successful.
Dec 05 14:08:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3095420e-8025-40c7-9c5e-b89c102e03ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f919cb-e947-48c0-9db3-1935fb1fd4d4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] <== disconnect_volume: return (602ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:08:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Deleting instance files /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa_del
Dec 05 14:08:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Deletion of /opt/stack/data/nova/instances/ab4d6587-2b04-46f7-9756-223a264a3efa_del complete
Dec 05 14:08:27 user nova-compute[75233]: INFO nova.compute.manager [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Took 1.48 seconds to destroy the instance on the hypervisor.
Dec 05 14:08:27 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:08:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:28 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Took 0.44 seconds to deallocate network for instance.
Dec 05 14:08:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-efc86e46-8304-4306-9877-ca964912fbbd req-933bc242-32a0-475f-a38a-817f0d2e41c2 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-deleted-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:28 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 067d8f98-27bb-4060-a03d-523eca3b15b0 is timed out.
Dec 05 14:08:28 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully detached device vdb from instance 067d8f98-27bb-4060-a03d-523eca3b15b0 from the live domain config.
Dec 05 14:08:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMNKnOUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:08:28 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99bc82-feda-4707-b4e6-724f2769a295]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:08:28 user nova-compute[75233]: No targets found.
Dec 05 14:08:28 user nova-compute[75233]: iSNS:
Dec 05 14:08:28 user nova-compute[75233]: No targets found.
Dec 05 14:08:28 user nova-compute[75233]: STATIC:
Dec 05 14:08:28 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f
Dec 05 14:08:28 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:08:28 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:08:28 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361
Dec 05 14:08:28 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:08:28 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:08:28 user nova-compute[75233]: FIRMWARE:
Dec 05 14:08:28 user nova-compute[75233]: No targets found.
Dec 05 14:08:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:08:28 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:08:28 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[79254334-87de-44f3-b6a7-8ead2596f994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ce855-de00-49ba-9f3e-257d450afcd9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:28 user nova-compute[75233]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 (non-flash)
Dec 05 14:08:28 user nova-compute[75233]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f600e6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[737e0aa4-b8f8-4938-ba57-d354c3407f1a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc9b90-946c-4f09-b939-b9922251a64d]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ef338-92b1-495a-8747-fd2f7fb214ca]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc392c7-fc52-4adf-96c1-e3802d8dec75]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c705e1b3-ec27-461d-a509-eb46df8d14cf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4865ca3b-a3a6-456e-8af9-ac5bc01820ad]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260]
Dec 05 14:08:28 user nova-compute[75233]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361, portal: 172.16.0.220,3260] successful.
Dec 05 14:08:28 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-7e51ddff-648d-4c8d-8a39-58288db70c97 req-feea088b-5ffe-4f92-aec7-16468f04c123 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7e51ddff-648d-4c8d-8a39-58288db70c97 req-feea088b-5ffe-4f92-aec7-16468f04c123 service nova] Acquiring lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7e51ddff-648d-4c8d-8a39-58288db70c97 req-feea088b-5ffe-4f92-aec7-16468f04c123 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7e51ddff-648d-4c8d-8a39-58288db70c97 req-feea088b-5ffe-4f92-aec7-16468f04c123 service nova] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-7e51ddff-648d-4c8d-8a39-58288db70c97 req-feea088b-5ffe-4f92-aec7-16468f04c123 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] No waiting events found dispatching network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:08:28 user nova-compute[75233]: WARNING nova.compute.manager [req-7e51ddff-648d-4c8d-8a39-58288db70c97 req-feea088b-5ffe-4f92-aec7-16468f04c123 service nova] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Received unexpected event network-vif-plugged-8cc45a19-cc12-4332-8254-0d66824372ad for instance with vm_state active and task_state deleting.
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5d7ec7-2c2c-4453-afc6-0171fa79d361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99f4f3-3e88-4230-aa78-b5f46905daea]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== disconnect_volume: return (303ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:29 user nova-compute[75233]: INFO nova.compute.manager [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: ab4d6587-2b04-46f7-9756-223a264a3efa] Took 0.96 seconds to detach 1 volumes for instance.
Dec 05 14:08:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:29 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Deleted allocations for instance ab4d6587-2b04-46f7-9756-223a264a3efa
Dec 05 14:08:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-33532fd1-6e88-49dc-b650-a07bc400bb4e tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "ab4d6587-2b04-46f7-9756-223a264a3efa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.336s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG nova.objects.instance [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'flavor' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-02390a19-8f63-4e0d-9f38-1989c0ee9428 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:08:30 user nova-compute[75233]: WARNING nova.compute.manager [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 14:08:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:08:30 user nova-compute[75233]: WARNING nova.compute.manager [req-26ed2f85-e2e7-49b1-b63a-c1413716f57c req-97fba013-d619-4ff1-af4e-29f6aef9f398 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 14:08:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:08:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:08:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance spawned successfully.
Dec 05 14:08:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:08:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1680bbb2-c996-405e-bc0a-9496a0cc2dfb tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.092s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-changed-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG nova.compute.manager [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Refreshing instance network info cache due to event network-changed-7e3df363-0dfb-47e1-9e7f-5ac627dff59a. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] Acquiring lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] Acquired lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Refreshing network info cache for port 7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updated VIF entry in instance network info cache for port 7e3df363-0dfb-47e1-9e7f-5ac627dff59a. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating instance_info_cache with network_info: [{"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:08:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01404535-e62f-4bdc-9300-ec7e98143c6b req-3268a308-d071-4e7e-b9dc-c13715e67883 service nova] Releasing lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:37 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'flavor' on Instance uuid f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:38 user nova-compute[75233]: INFO nova.compute.manager [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Attaching volume aef687fe-f440-433f-a39c-2064b28e64e5 to /dev/vdb
Dec 05 14:08:38 user nova-compute[75233]: DEBUG os_brick.utils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6be30ec-39cc-47cd-952f-31ead86b81ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a78377-acd4-4c62-84ed-23c492b5d76c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2712269-8765-43e6-b763-97c430d9f371]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[64353a3e-2c2b-42d4-a00e-18e7fe221a08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:08:38 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:08:38 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91bf3a5-6c01-4756-beba-f49bdc97fea8]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG os_brick.utils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:08:38 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating existing volume attachment record: a212a0b1-cc55-4cff-90b9-f71d74189089 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:08:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luwTXzaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:08:47 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:08:47 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:08:47 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f9e30-7948-41a1-b449-c0fcfe34e66a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:08:47 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba5951c-a8c1-460a-9642-9070ab2701d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5] added
Dec 05 14:08:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3471bb-4f53-4cf0-b75d-1e14a41a2b15]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a2c1a-7a1e-4bc2-8a1e-e220ab72ecd4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luwTXzaM {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luwTXzaM" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca975ffb-0207-4d55-87ca-193beffab3a5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'luwTXzaM'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6dc6d-3859-4b27-b4a1-f2f421def4e5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3863536-7ed6-4993-9a17-9a537029cb39]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f7b7dc-121d-41c8-899f-330d06fb09b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260]
Dec 05 14:08:47 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260] successful.
Dec 05 14:08:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970b8b6-35c7-47e5-b21c-3e48e6812f05]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f20843b-e8da-4538-934f-2ef1e161359b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:47 user nova-compute[75233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 (non-flash)
Dec 05 14:08:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:08:47 user nova-compute[75233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 (non-flash)
Dec 05 14:08:47 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2090ec96-f2ed-4548-9974-54f3a1f4b05b]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:08:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luwTXzaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:08:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:08:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23333323565623730', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:08:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333323565623730', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:08:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'flavor' on Instance uuid f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:08:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:08:48 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:08:48 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:08:48 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:08:48 user nova-compute[75233]:   <serial>aef687fe-f440-433f-a39c-2064b28e64e5</serial>
Dec 05 14:08:48 user nova-compute[75233]: </disk>
Dec 05 14:08:48 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:08:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:08:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:08:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] No VIF found with MAC fa:16:3e:7a:af:33, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:08:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a8593019-f6d5-46ab-85cb-bbdf1ab50b69 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.216s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:08:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:08:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:08:51 user nova-compute[75233]: INFO nova.compute.manager [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Detaching volume aef687fe-f440-433f-a39c-2064b28e64e5
Dec 05 14:08:51 user nova-compute[75233]: INFO nova.virt.block_device [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Attempting to driver detach volume aef687fe-f440-433f-a39c-2064b28e64e5 from mountpoint /dev/vdb
Dec 05 14:08:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Attempting to detach device vdb from instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:08:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:08:51 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:08:51 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:08:51 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:08:51 user nova-compute[75233]:   <serial>aef687fe-f440-433f-a39c-2064b28e64e5</serial>
Dec 05 14:08:51 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:08:51 user nova-compute[75233]: </disk>
Dec 05 14:08:51 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:08:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully detached device vdb from instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 from the persistent domain config.
Dec 05 14:08:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:08:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:08:51 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:08:51 user nova-compute[75233]:   <source dev="/dev/sdc"/>
Dec 05 14:08:51 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:08:51 user nova-compute[75233]:   <serial>aef687fe-f440-433f-a39c-2064b28e64e5</serial>
Dec 05 14:08:51 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:08:51 user nova-compute[75233]: </disk>
Dec 05 14:08:51 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:08:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:08:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:08:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:01 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:02 user nova-compute[75233]: INFO nova.compute.manager [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Terminating instance
Dec 05 14:09:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-cc162880-5f31-472b-b28b-865725f332ed req-956d591a-32cb-43bb-92d9-d39ef8fc96ad service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-unplugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cc162880-5f31-472b-b28b-865725f332ed req-956d591a-32cb-43bb-92d9-d39ef8fc96ad service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cc162880-5f31-472b-b28b-865725f332ed req-956d591a-32cb-43bb-92d9-d39ef8fc96ad service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-cc162880-5f31-472b-b28b-865725f332ed req-956d591a-32cb-43bb-92d9-d39ef8fc96ad service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-cc162880-5f31-472b-b28b-865725f332ed req-956d591a-32cb-43bb-92d9-d39ef8fc96ad service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-unplugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-cc162880-5f31-472b-b28b-865725f332ed req-956d591a-32cb-43bb-92d9-d39ef8fc96ad service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-unplugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:09:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Instance destroyed successfully.
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.objects.instance [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'resources' on Instance uuid 067d8f98-27bb-4060-a03d-523eca3b15b0 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1220587598',display_name='tempest-TestMinimumBasicScenario-server-1220587598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1220587598',id=40,image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8fJ4GMTaMLuKqPPVYNVBgn2esxqOFf3HigtQN1+PING/Dtkzlrbiqe91ADVBg5XN9xHSmBF3euZPSnYeU5plRbTr3rRTZ91qZu1o5B3XLfQeYUEKqAqnHq288JOoYLow==',key_name='tempest-TestMinimumBasicScenario-1564917942',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-kq2d775d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='90d63c40-fc0a-4d0a-b93b-273dffffbffa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:06:22Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=067d8f98-27bb-4060-a03d-523eca3b15b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "f8f03810-26d5-4443-9557-35623e658ffc", "address": "fa:16:3e:aa:15:bb", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f03810-26", "ovs_interfaceid": "f8f03810-26d5-4443-9557-35623e658ffc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG os_vif [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8f03810-26, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6da8631a-eb96-4d51-b9f9-ac91119cee0e) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:03 user nova-compute[75233]: INFO os_vif [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:15:bb,bridge_name='br-int',has_traffic_filtering=True,id=f8f03810-26d5-4443-9557-35623e658ffc,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f03810-26')
Dec 05 14:09:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Deleting instance files /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0_del
Dec 05 14:09:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Deletion of /opt/stack/data/nova/instances/067d8f98-27bb-4060-a03d-523eca3b15b0_del complete
Dec 05 14:09:03 user nova-compute[75233]: INFO nova.compute.manager [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 14:09:03 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:03 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Took 0.49 seconds to deallocate network for instance.
Dec 05 14:09:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:04 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Deleted allocations for instance 067d8f98-27bb-4060-a03d-523eca3b15b0
Dec 05 14:09:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-de2ce7e8-3c7f-44aa-9636-c8f32d182469 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] Acquiring lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] Lock "067d8f98-27bb-4060-a03d-523eca3b15b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] No waiting events found dispatching network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:09:04 user nova-compute[75233]: WARNING nova.compute.manager [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received unexpected event network-vif-plugged-f8f03810-26d5-4443-9557-35623e658ffc for instance with vm_state deleted and task_state None.
Dec 05 14:09:04 user nova-compute[75233]: DEBUG nova.compute.manager [req-389e5700-8820-4a71-8894-1480a35b93a1 req-ff0d06f7-09f5-41cf-a2c5-cb2e386e318e service nova] [instance: 067d8f98-27bb-4060-a03d-523eca3b15b0] Received event network-vif-deleted-f8f03810-26d5-4443-9557-35623e658ffc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:09:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8516MB free_disk=24.686187744140625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ce34db0a-bdc8-4379-8987-1ed437357311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:09:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:11 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 is timed out.
Dec 05 14:09:11 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully detached device vdb from instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 from the live domain config.
Dec 05 14:09:11 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luwTXzaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:09:11 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3498c349-7818-4d8f-b7c9-0d4126663146]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:09:11 user nova-compute[75233]: No targets found.
Dec 05 14:09:11 user nova-compute[75233]: iSNS:
Dec 05 14:09:11 user nova-compute[75233]: No targets found.
Dec 05 14:09:11 user nova-compute[75233]: STATIC:
Dec 05 14:09:11 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f
Dec 05 14:09:11 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:09:11 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:09:11 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5
Dec 05 14:09:11 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:09:11 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:09:11 user nova-compute[75233]: FIRMWARE:
Dec 05 14:09:11 user nova-compute[75233]: No targets found.
Dec 05 14:09:11 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:09:11 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:09:11 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff699a9-1659-487f-ad74-5c97d3db619a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b84172-2887-489f-b177-6af44ff732b7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:09:11 user nova-compute[75233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 (non-flash)
Dec 05 14:09:11 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:09:11 user nova-compute[75233]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 (non-flash)
Dec 05 14:09:11 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f347769e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe54a53-26c1-4cc0-a6c0-45874a5fedce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3002275-d43e-45c0-bfcc-97467403d5b4]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed87e73-f197-44e6-b228-98a618f1920c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:09:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fcdb9c-8b16-40d5-a01d-b9e2e6d58533]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c9fec4-8481-4d9b-8e9d-048a835c95ca]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290dcf8-c413-49d3-a744-d426b469da26]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260]
Dec 05 14:09:12 user nova-compute[75233]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5, portal: 172.16.0.220,3260] successful.
Dec 05 14:09:12 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aef687fe-f440-433f-a39c-2064b28e64e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[57acf44a-5cb7-4bec-8eed-a65e3dbdbce2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] <== disconnect_volume: return (290ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG nova.objects.instance [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'flavor' on Instance uuid f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:09:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-be849815-0631-4f7c-bbb1-c5a6ee9bcc9c tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:16 user nova-compute[75233]: INFO nova.compute.manager [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Terminating instance
Dec 05 14:09:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7b9fcd5-bffe-4bd1-80c0-af094323f221 req-6826bebc-d5b0-46b7-9b81-3b782dd2fa07 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-vif-unplugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7b9fcd5-bffe-4bd1-80c0-af094323f221 req-6826bebc-d5b0-46b7-9b81-3b782dd2fa07 service nova] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7b9fcd5-bffe-4bd1-80c0-af094323f221 req-6826bebc-d5b0-46b7-9b81-3b782dd2fa07 service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d7b9fcd5-bffe-4bd1-80c0-af094323f221 req-6826bebc-d5b0-46b7-9b81-3b782dd2fa07 service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7b9fcd5-bffe-4bd1-80c0-af094323f221 req-6826bebc-d5b0-46b7-9b81-3b782dd2fa07 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] No waiting events found dispatching network-vif-unplugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-d7b9fcd5-bffe-4bd1-80c0-af094323f221 req-6826bebc-d5b0-46b7-9b81-3b782dd2fa07 service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-vif-unplugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:09:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Instance destroyed successfully.
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lazy-loading 'resources' on Instance uuid 3f5b5067-5f96-48a8-a6da-7630b1a972d6 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-617403913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-617403913',id=26,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd04a994cbca48239afebd5080f31725',ramdisk_id='',reservation_id='r-217t2rr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-264323439',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:51:38Z,user_data=None,user_id='df61cbca359144e4a0c9ce81b51ebcee',uuid=3f5b5067-5f96-48a8-a6da-7630b1a972d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converting VIF {"id": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "address": "fa:16:3e:40:ee:73", "network": {"id": "fbf2f569-cc31-4a07-a579-c41b3dabc30c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1443906660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd04a994cbca48239afebd5080f31725", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e06e2d2-db", "ovs_interfaceid": "0e06e2d2-db8d-4e7d-beb9-949b595cc673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG os_vif [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e06e2d2-db, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74a29e3d-1012-4b16-8388-6419fe325dd8) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:17 user nova-compute[75233]: INFO os_vif [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=0e06e2d2-db8d-4e7d-beb9-949b595cc673,network=Network(fbf2f569-cc31-4a07-a579-c41b3dabc30c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e06e2d2-db')
Dec 05 14:09:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Deleting instance files /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6_del
Dec 05 14:09:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Deletion of /opt/stack/data/nova/instances/3f5b5067-5f96-48a8-a6da-7630b1a972d6_del complete
Dec 05 14:09:17 user nova-compute[75233]: INFO nova.compute.manager [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 05 14:09:17 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:09:17 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:09:18 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:18 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Took 0.46 seconds to deallocate network for instance.
Dec 05 14:09:18 user nova-compute[75233]: DEBUG nova.compute.manager [req-ababe1c8-3083-4f7f-bbf7-5b75f539fc12 req-ab4ee07e-be46-432a-8901-401c0eabb28e service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-vif-deleted-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:18 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:09:18 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:09:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:18 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Deleted allocations for instance 3f5b5067-5f96-48a8-a6da-7630b1a972d6
Dec 05 14:09:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e28e8c22-39e5-486c-8ffe-fc50b59f6a89 tempest-ServerBootFromVolumeStableRescueTest-264323439 tempest-ServerBootFromVolumeStableRescueTest-264323439-project-member] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.782s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-b00cf476-692c-4452-a47a-fa1dc6e100aa req-05253528-cb39-4866-99b0-a052056286ef service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received event network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b00cf476-692c-4452-a47a-fa1dc6e100aa req-05253528-cb39-4866-99b0-a052056286ef service nova] Acquiring lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b00cf476-692c-4452-a47a-fa1dc6e100aa req-05253528-cb39-4866-99b0-a052056286ef service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b00cf476-692c-4452-a47a-fa1dc6e100aa req-05253528-cb39-4866-99b0-a052056286ef service nova] Lock "3f5b5067-5f96-48a8-a6da-7630b1a972d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:19 user nova-compute[75233]: DEBUG nova.compute.manager [req-b00cf476-692c-4452-a47a-fa1dc6e100aa req-05253528-cb39-4866-99b0-a052056286ef service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] No waiting events found dispatching network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:09:19 user nova-compute[75233]: WARNING nova.compute.manager [req-b00cf476-692c-4452-a47a-fa1dc6e100aa req-05253528-cb39-4866-99b0-a052056286ef service nova] [instance: 3f5b5067-5f96-48a8-a6da-7630b1a972d6] Received unexpected event network-vif-plugged-0e06e2d2-db8d-4e7d-beb9-949b595cc673 for instance with vm_state deleted and task_state None.
Dec 05 14:09:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:09:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:09:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:09:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:09:22 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:09:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:23 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating instance_info_cache with network_info: [{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:09:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:09:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:09:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:09:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:09:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:09:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:09:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:09:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-changed-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Refreshing instance network info cache due to event network-changed-7e3df363-0dfb-47e1-9e7f-5ac627dff59a. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] Acquiring lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] Acquired lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Refreshing network info cache for port 7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:42 user nova-compute[75233]: INFO nova.compute.manager [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Terminating instance
Dec 05 14:09:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updated VIF entry in instance network info cache for port 7e3df363-0dfb-47e1-9e7f-5ac627dff59a. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating instance_info_cache with network_info: [{"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0a45e8d8-3aaa-4efd-a23f-a42428c3f3c9 req-1e6a0d06-c90a-4907-90f7-372818bb45ce service nova] Releasing lock "refresh_cache-f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Instance destroyed successfully.
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.objects.instance [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'resources' on Instance uuid f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2128918561',display_name='tempest-TestStampPattern-server-2128918561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2128918561',id=42,image_ref='e39311d8-12f5-4dd5-b13d-b24898ff150f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIedrrr5CE8wjPd1SkAUTBltBGqS1dEEAtKuYjsNtuqZmT4zwIJLInTE1TYClnheTxTqpcj8MCv2abVGlc40j1ekh9WoFXKSYiBc/BClcwOcdjLtjTZMB8WsYkVzRpRPg==',key_name='tempest-TestStampPattern-1706655752',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08fec6162ff24a32872749d6da8cba62',ramdisk_id='',reservation_id='r-68xqqe8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9',image_min_disk='1',image_min_ram='0',image_owner_id='08fec6162ff24a32872749d6da8cba62',image_owner_project_name='tempest-TestStampPattern-1121995077',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1121995077-project-member',image_user_id='1250912fa96345cc8b33124bc57e5a66',owner_project_name='tempest-TestStampPattern-1121995077',owner_user_name='tempest-TestStampPattern-1121995077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:06:52Z,user_data=None,user_id='1250912fa96345cc8b33124bc57e5a66',uuid=f7877f1b-b2c4-4ba7-84a6-28a8f71f3368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converting VIF {"id": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "address": "fa:16:3e:7a:af:33", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3df363-0d", "ovs_interfaceid": "7e3df363-0dfb-47e1-9e7f-5ac627dff59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG os_vif [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e3df363-0d, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29c757f3-fcdd-4d05-ad31-bd0e8b536c30) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:43 user nova-compute[75233]: INFO os_vif [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:af:33,bridge_name='br-int',has_traffic_filtering=True,id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3df363-0d')
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Deleting instance files /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368_del
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Deletion of /opt/stack/data/nova/instances/f7877f1b-b2c4-4ba7-84a6-28a8f71f3368_del complete
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.compute.manager [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 05 14:09:43 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Took 0.44 seconds to deallocate network for instance.
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-2952c5fc-6b2d-4f21-af00-f6c3dc440f55 req-288ce956-d664-4198-95ad-83e127574111 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-vif-deleted-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.compute.manager [req-2952c5fc-6b2d-4f21-af00-f6c3dc440f55 req-288ce956-d664-4198-95ad-83e127574111 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Neutron deleted interface 7e3df363-0dfb-47e1-9e7f-5ac627dff59a; detaching it from the instance and deleting it from the info cache
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.network.neutron [req-2952c5fc-6b2d-4f21-af00-f6c3dc440f55 req-288ce956-d664-4198-95ad-83e127574111 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.compute.manager [req-2952c5fc-6b2d-4f21-af00-f6c3dc440f55 req-288ce956-d664-4198-95ad-83e127574111 service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Detach interface failed, port_id=7e3df363-0dfb-47e1-9e7f-5ac627dff59a, reason: Instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:09:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:43 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Deleted allocations for instance f7877f1b-b2c4-4ba7-84a6-28a8f71f3368
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-00c91e5b-8a50-4385-9347-35d1af7467e1 tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-vif-unplugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] No waiting events found dispatching network-vif-unplugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:09:44 user nova-compute[75233]: WARNING nova.compute.manager [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received unexpected event network-vif-unplugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a for instance with vm_state deleted and task_state None.
Dec 05 14:09:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received event network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] Acquiring lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] Lock "f7877f1b-b2c4-4ba7-84a6-28a8f71f3368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] No waiting events found dispatching network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:09:44 user nova-compute[75233]: WARNING nova.compute.manager [req-2c9f9b94-3804-4a3e-a58f-29d9e1b3eb6f req-b5abcc93-01c5-4aca-8dfa-824e11cd4c1b service nova] [instance: f7877f1b-b2c4-4ba7-84a6-28a8f71f3368] Received unexpected event network-vif-plugged-7e3df363-0dfb-47e1-9e7f-5ac627dff59a for instance with vm_state deleted and task_state None.
Dec 05 14:09:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:09:56 user nova-compute[75233]: INFO nova.compute.claims [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Claim successful on node user
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.network.neutron [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:09:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.policy [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b3ba7c68eeb411a8c3cf77748216e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1d061238f6482c9a10d751ab1d2abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:09:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Creating image(s)
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "/opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "/opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "e329e75c1e7ace0ad8055bb1c32fc95a03802d7b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "e329e75c1e7ace0ad8055bb1c32fc95a03802d7b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG nova.network.neutron [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Successfully created port: d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG nova.virt.images [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] 1a365a74-8c99-46ad-8ce3-c93d4f68fdc6 was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.part /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.part /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.converted" returned: 0 in 0.295s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "e329e75c1e7ace0ad8055bb1c32fc95a03802d7b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.044s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Successfully updated port: d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing instance network info cache due to event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b --force-share --output=json" returned: 0 in 0.289s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "e329e75c1e7ace0ad8055bb1c32fc95a03802d7b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "e329e75c1e7ace0ad8055bb1c32fc95a03802d7b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f56feaa5-2647-4e66-ad6b-3827464950ad req-8ad00117-0db2-44af-b0dc-d9366c145e00 service nova] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b,backing_fmt=raw /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b,backing_fmt=raw /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk 1073741824" returned: 0 in 0.049s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "e329e75c1e7ace0ad8055bb1c32fc95a03802d7b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.neutron [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance network_info: |[{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Cannot resize image /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Ensure instance console log exists: /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Start _get_guest_xml network_info=[{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T14:09:54Z,direct_url=<?>,disk_format='qcow2',id=1a365a74-8c99-46ad-8ce3-c93d4f68fdc6,min_disk=0,min_ram=0,name='tempest-scenario-img--5325964',owner='cd1d061238f6482c9a10d751ab1d2abd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T14:09:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '1a365a74-8c99-46ad-8ce3-c93d4f68fdc6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:09:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:09:58 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T14:09:54Z,direct_url=<?>,disk_format='qcow2',id=1a365a74-8c99-46ad-8ce3-c93d4f68fdc6,min_disk=0,min_ram=0,name='tempest-scenario-img--5325964',owner='cd1d061238f6482c9a10d751ab1d2abd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T14:09:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1536377839',display_name='tempest-TestMinimumBasicScenario-server-1536377839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1536377839',id=43,image_ref='1a365a74-8c99-46ad-8ce3-c93d4f68fdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsXmvGyro5uxlsG5bMlfWjIPiNFZMOyps9WbUMmW+M6GBbzfE5hdEfBBVQePtxtnUj326kUcK3NU5d8B3qiqQGwlkljhEmJ19kcidQ7bEYXmhBELULzt0Y5H0pr/8OYsQ==',key_name='tempest-TestMinimumBasicScenario-1495418633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-lv33kvbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a365a74-8c99-46ad-8ce3-c93d4f68fdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:09:57Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=dfe66be3-ee6e-4e42-baa9-9ce598b710bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'pci_devices' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:09:58 user nova-compute[75233]:   <uuid>dfe66be3-ee6e-4e42-baa9-9ce598b710bf</uuid>
Dec 05 14:09:58 user nova-compute[75233]:   <name>instance-0000002b</name>
Dec 05 14:09:58 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:09:58 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:09:58 user nova-compute[75233]:   <metadata>
Dec 05 14:09:58 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:09:58 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:09:58 user nova-compute[75233]:       <nova:name>tempest-TestMinimumBasicScenario-server-1536377839</nova:name>
Dec 05 14:09:58 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:09:58</nova:creationTime>
Dec 05 14:09:58 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:09:58 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:09:58 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:09:58 user nova-compute[75233]:       <nova:owner>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:user uuid="6b3ba7c68eeb411a8c3cf77748216e65">tempest-TestMinimumBasicScenario-235565151-project-member</nova:user>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:project uuid="cd1d061238f6482c9a10d751ab1d2abd">tempest-TestMinimumBasicScenario-235565151</nova:project>
Dec 05 14:09:58 user nova-compute[75233]:       </nova:owner>
Dec 05 14:09:58 user nova-compute[75233]:       <nova:root type="image" uuid="1a365a74-8c99-46ad-8ce3-c93d4f68fdc6"/>
Dec 05 14:09:58 user nova-compute[75233]:       <nova:ports>
Dec 05 14:09:58 user nova-compute[75233]:         <nova:port uuid="d8b2be0b-938e-4c44-ad94-b801ad0623d1">
Dec 05 14:09:58 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 14:09:58 user nova-compute[75233]:         </nova:port>
Dec 05 14:09:58 user nova-compute[75233]:       </nova:ports>
Dec 05 14:09:58 user nova-compute[75233]:     </nova:instance>
Dec 05 14:09:58 user nova-compute[75233]:   </metadata>
Dec 05 14:09:58 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:09:58 user nova-compute[75233]:     <system>
Dec 05 14:09:58 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:09:58 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:09:58 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:09:58 user nova-compute[75233]:       <entry name="serial">dfe66be3-ee6e-4e42-baa9-9ce598b710bf</entry>
Dec 05 14:09:58 user nova-compute[75233]:       <entry name="uuid">dfe66be3-ee6e-4e42-baa9-9ce598b710bf</entry>
Dec 05 14:09:58 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:09:58 user nova-compute[75233]:     </system>
Dec 05 14:09:58 user nova-compute[75233]:   </sysinfo>
Dec 05 14:09:58 user nova-compute[75233]:   <os>
Dec 05 14:09:58 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:09:58 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:09:58 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:09:58 user nova-compute[75233]:   </os>
Dec 05 14:09:58 user nova-compute[75233]:   <features>
Dec 05 14:09:58 user nova-compute[75233]:     <acpi/>
Dec 05 14:09:58 user nova-compute[75233]:     <apic/>
Dec 05 14:09:58 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:09:58 user nova-compute[75233]:   </features>
Dec 05 14:09:58 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:09:58 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:09:58 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:09:58 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:09:58 user nova-compute[75233]:   </clock>
Dec 05 14:09:58 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:09:58 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:09:58 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:09:58 user nova-compute[75233]:   </cpu>
Dec 05 14:09:58 user nova-compute[75233]:   <devices>
Dec 05 14:09:58 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:09:58 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:09:58 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk"/>
Dec 05 14:09:58 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:09:58 user nova-compute[75233]:     </disk>
Dec 05 14:09:58 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:09:58 user nova-compute[75233]:       <mac address="fa:16:3e:66:1f:ff"/>
Dec 05 14:09:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:09:58 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:09:58 user nova-compute[75233]:       <target dev="tapd8b2be0b-93"/>
Dec 05 14:09:58 user nova-compute[75233]:     </interface>
Dec 05 14:09:58 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:09:58 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/console.log" append="off"/>
Dec 05 14:09:58 user nova-compute[75233]:     </serial>
Dec 05 14:09:58 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:09:58 user nova-compute[75233]:     <video>
Dec 05 14:09:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:09:58 user nova-compute[75233]:     </video>
Dec 05 14:09:58 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:09:58 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:09:58 user nova-compute[75233]:     </rng>
Dec 05 14:09:58 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:09:58 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:09:58 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:09:58 user nova-compute[75233]:     </memballoon>
Dec 05 14:09:58 user nova-compute[75233]:   </devices>
Dec 05 14:09:58 user nova-compute[75233]: </domain>
Dec 05 14:09:58 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1536377839',display_name='tempest-TestMinimumBasicScenario-server-1536377839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1536377839',id=43,image_ref='1a365a74-8c99-46ad-8ce3-c93d4f68fdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsXmvGyro5uxlsG5bMlfWjIPiNFZMOyps9WbUMmW+M6GBbzfE5hdEfBBVQePtxtnUj326kUcK3NU5d8B3qiqQGwlkljhEmJ19kcidQ7bEYXmhBELULzt0Y5H0pr/8OYsQ==',key_name='tempest-TestMinimumBasicScenario-1495418633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-lv33kvbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a365a74-8c99-46ad-8ce3-c93d4f68fdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:09:57Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=dfe66be3-ee6e-4e42-baa9-9ce598b710bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG os_vif [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8229955-c57c-5b9a-a0c5-7b22bbf0265a', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8b2be0b-93, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8b2be0b-93, col_values=(('qos', UUID('fd743158-6767-4128-825a-c7027341dac9')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8b2be0b-93, col_values=(('external_ids', {'iface-id': 'd8b2be0b-938e-4c44-ad94-b801ad0623d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:1f:ff', 'vm-uuid': 'dfe66be3-ee6e-4e42-baa9-9ce598b710bf'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:09:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:09:59 user nova-compute[75233]: INFO os_vif [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93')
Dec 05 14:09:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:09:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No VIF found with MAC fa:16:3e:66:1f:ff, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:00 user nova-compute[75233]: INFO nova.compute.manager [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Detaching volume c15a3602-2ebb-4c08-b84e-befec193a20f
Dec 05 14:10:00 user nova-compute[75233]: INFO nova.virt.block_device [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Attempting to driver detach volume c15a3602-2ebb-4c08-b84e-befec193a20f from mountpoint /dev/vdc
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Attempting to detach device vdc from instance ce34db0a-bdc8-4379-8987-1ed437357311 from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:10:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:10:00 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:10:00 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 14:10:00 user nova-compute[75233]:   <serial>c15a3602-2ebb-4c08-b84e-befec193a20f</serial>
Dec 05 14:10:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 14:10:00 user nova-compute[75233]: </disk>
Dec 05 14:10:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:10:00 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully detached device vdc from instance ce34db0a-bdc8-4379-8987-1ed437357311 from the persistent domain config.
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ce34db0a-bdc8-4379-8987-1ed437357311 from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:10:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:10:00 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:10:00 user nova-compute[75233]:   <target dev="vdc" bus="virtio"/>
Dec 05 14:10:00 user nova-compute[75233]:   <serial>c15a3602-2ebb-4c08-b84e-befec193a20f</serial>
Dec 05 14:10:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 14:10:00 user nova-compute[75233]: </disk>
Dec 05 14:10:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-01bc202b-e615-4ba9-9f7f-3854ead5cecd req-34d2d98c-c96b-40b6-a528-574722c8e223 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01bc202b-e615-4ba9-9f7f-3854ead5cecd req-34d2d98c-c96b-40b6-a528-574722c8e223 service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01bc202b-e615-4ba9-9f7f-3854ead5cecd req-34d2d98c-c96b-40b6-a528-574722c8e223 service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01bc202b-e615-4ba9-9f7f-3854ead5cecd req-34d2d98c-c96b-40b6-a528-574722c8e223 service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-01bc202b-e615-4ba9-9f7f-3854ead5cecd req-34d2d98c-c96b-40b6-a528-574722c8e223 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:10:00 user nova-compute[75233]: WARNING nova.compute.manager [req-01bc202b-e615-4ba9-9f7f-3854ead5cecd req-34d2d98c-c96b-40b6-a528-574722c8e223 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state building and task_state spawning.
Dec 05 14:10:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:10:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-8faa7b64-a654-4d11-8da5-c1c41aa615cb req-43ea7bb1-5941-480f-83d4-4979b97f9b7e service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8faa7b64-a654-4d11-8da5-c1c41aa615cb req-43ea7bb1-5941-480f-83d4-4979b97f9b7e service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8faa7b64-a654-4d11-8da5-c1c41aa615cb req-43ea7bb1-5941-480f-83d4-4979b97f9b7e service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8faa7b64-a654-4d11-8da5-c1c41aa615cb req-43ea7bb1-5941-480f-83d4-4979b97f9b7e service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-8faa7b64-a654-4d11-8da5-c1c41aa615cb req-43ea7bb1-5941-480f-83d4-4979b97f9b7e service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:10:02 user nova-compute[75233]: WARNING nova.compute.manager [req-8faa7b64-a654-4d11-8da5-c1c41aa615cb req-43ea7bb1-5941-480f-83d4-4979b97f9b7e service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state building and task_state spawning.
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:10:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance spawned successfully.
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:10:02 user nova-compute[75233]: INFO nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Took 5.98 seconds to spawn the instance on the hypervisor.
Dec 05 14:10:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:10:02 user nova-compute[75233]: INFO nova.compute.manager [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Took 6.54 seconds to build instance.
Dec 05 14:10:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2ed9ebd7-5564-4c26-8276-0fdeb0121c3b tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.655s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:03 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:03 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:10:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=24.789794921875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance ce34db0a-bdc8-4379-8987-1ed437357311 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:10:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:10:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:10:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:10:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:10:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:10:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:10:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:20 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ce34db0a-bdc8-4379-8987-1ed437357311 is timed out.
Dec 05 14:10:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully detached device vdc from instance ce34db0a-bdc8-4379-8987-1ed437357311 from the live domain config.
Dec 05 14:10:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUYnMDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:10:20 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb62940-6f47-4a4c-962d-e63d1b591613]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:10:20 user nova-compute[75233]: No targets found.
Dec 05 14:10:20 user nova-compute[75233]: iSNS:
Dec 05 14:10:20 user nova-compute[75233]: No targets found.
Dec 05 14:10:20 user nova-compute[75233]: STATIC:
Dec 05 14:10:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f
Dec 05 14:10:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:10:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:10:20 user nova-compute[75233]: FIRMWARE:
Dec 05 14:10:20 user nova-compute[75233]: No targets found.
Dec 05 14:10:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:10:20 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:10:20 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba10acc-2403-4b4d-9dc4-8279fc6460d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c41257-559f-44e1-8984-f035183b037d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:10:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f (non-flash)
Dec 05 14:10:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34774310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[82109d7d-ac36-41ee-90ee-6d22522183a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9342e625-5230-402b-9267-aba0f6d590f4]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc987be-5de6-4906-a9a6-c6a629af0561]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcc654c-bc4f-4ce8-8db1-d4b193be90b9]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff21627f-1f14-4098-b6f2-8bc5be9f902e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:10:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a5422-5c6d-4a22-911f-0bbdb55e5bbf]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260]
Dec 05 14:10:21 user nova-compute[75233]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f, portal: 172.16.0.220,3260] successful.
Dec 05 14:10:21 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c15a3602-2ebb-4c08-b84e-befec193a20f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc70c22-baf5-4cb3-a8e5-fae5916b42ae]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] <== disconnect_volume: return (301ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'flavor' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:10:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-38d7339d-937a-4059-9e4a-91213d01b3c2 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:10:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:10:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:10:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:10:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-changed-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG nova.compute.manager [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Refreshing instance network info cache due to event network-changed-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] Acquiring lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] Acquired lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG nova.network.neutron [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Refreshing network info cache for port e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:45 user nova-compute[75233]: INFO nova.compute.manager [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Terminating instance
Dec 05 14:10:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-aa3edffe-dd5f-4dab-842b-d69c6f9e6464 req-f9df50b1-c06e-43c4-b96e-6186b3192972 service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-vif-unplugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aa3edffe-dd5f-4dab-842b-d69c6f9e6464 req-f9df50b1-c06e-43c4-b96e-6186b3192972 service nova] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aa3edffe-dd5f-4dab-842b-d69c6f9e6464 req-f9df50b1-c06e-43c4-b96e-6186b3192972 service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aa3edffe-dd5f-4dab-842b-d69c6f9e6464 req-f9df50b1-c06e-43c4-b96e-6186b3192972 service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-aa3edffe-dd5f-4dab-842b-d69c6f9e6464 req-f9df50b1-c06e-43c4-b96e-6186b3192972 service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] No waiting events found dispatching network-vif-unplugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.compute.manager [req-aa3edffe-dd5f-4dab-842b-d69c6f9e6464 req-f9df50b1-c06e-43c4-b96e-6186b3192972 service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-vif-unplugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.network.neutron [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updated VIF entry in instance network info cache for port e8e2a350-bc1c-4b64-b7f4-73bbe37679fc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.network.neutron [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating instance_info_cache with network_info: [{"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-75ebe43b-5e82-429a-9de9-cef88a90f1d8 req-484e96b6-0748-4b13-97d3-19cd11ebad4d service nova] Releasing lock "refresh_cache-46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Instance destroyed successfully.
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lazy-loading 'resources' on Instance uuid 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:03:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1791237440',display_name='tempest-TestStampPattern-server-1791237440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1791237440',id=39,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIedrrr5CE8wjPd1SkAUTBltBGqS1dEEAtKuYjsNtuqZmT4zwIJLInTE1TYClnheTxTqpcj8MCv2abVGlc40j1ekh9WoFXKSYiBc/BClcwOcdjLtjTZMB8WsYkVzRpRPg==',key_name='tempest-TestStampPattern-1706655752',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08fec6162ff24a32872749d6da8cba62',ramdisk_id='',reservation_id='r-vbm2iipv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1121995077',owner_user_name='tempest-TestStampPattern-1121995077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:06:43Z,user_data=None,user_id='1250912fa96345cc8b33124bc57e5a66',uuid=46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converting VIF {"id": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "address": "fa:16:3e:94:cc:11", "network": {"id": "c83cef31-abac-4bf7-9b9b-e8c7676a8647", "bridge": "br-int", "label": "tempest-TestStampPattern-1211291715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08fec6162ff24a32872749d6da8cba62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e2a350-bc", "ovs_interfaceid": "e8e2a350-bc1c-4b64-b7f4-73bbe37679fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG os_vif [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8e2a350-bc, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e66d591c-e9a7-4e89-ba10-398f925f1e13) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:10:46 user nova-compute[75233]: INFO os_vif [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:cc:11,bridge_name='br-int',has_traffic_filtering=True,id=e8e2a350-bc1c-4b64-b7f4-73bbe37679fc,network=Network(c83cef31-abac-4bf7-9b9b-e8c7676a8647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e2a350-bc')
Dec 05 14:10:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Deleting instance files /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9_del
Dec 05 14:10:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Deletion of /opt/stack/data/nova/instances/46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9_del complete
Dec 05 14:10:46 user nova-compute[75233]: INFO nova.compute.manager [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 14:10:46 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:10:46 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:10:47 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:10:47 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Took 0.52 seconds to deallocate network for instance.
Dec 05 14:10:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:47 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:10:47 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:10:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:47 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Deleted allocations for instance 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9
Dec 05 14:10:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-0755d54e-3a6d-4910-92b3-108249af2c0f tempest-TestStampPattern-1121995077 tempest-TestStampPattern-1121995077-project-member] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-69c63e87-c6fc-42a9-a5d0-98fa84d6f480 req-86622cae-1495-492d-afd9-81578419184d service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-vif-deleted-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-67d7c2f8-ab34-42e1-b036-fd21558b138f req-2ef577ae-f958-41d4-936e-530d9eecde3c service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received event network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-67d7c2f8-ab34-42e1-b036-fd21558b138f req-2ef577ae-f958-41d4-936e-530d9eecde3c service nova] Acquiring lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-67d7c2f8-ab34-42e1-b036-fd21558b138f req-2ef577ae-f958-41d4-936e-530d9eecde3c service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-67d7c2f8-ab34-42e1-b036-fd21558b138f req-2ef577ae-f958-41d4-936e-530d9eecde3c service nova] Lock "46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:48 user nova-compute[75233]: DEBUG nova.compute.manager [req-67d7c2f8-ab34-42e1-b036-fd21558b138f req-2ef577ae-f958-41d4-936e-530d9eecde3c service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] No waiting events found dispatching network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:10:48 user nova-compute[75233]: WARNING nova.compute.manager [req-67d7c2f8-ab34-42e1-b036-fd21558b138f req-2ef577ae-f958-41d4-936e-530d9eecde3c service nova] [instance: 46f1eae2-6d0a-4f0b-8d8f-4314ad7174f9] Received unexpected event network-vif-plugged-e8e2a350-bc1c-4b64-b7f4-73bbe37679fc for instance with vm_state deleted and task_state None.
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:50 user nova-compute[75233]: INFO nova.compute.manager [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Terminating instance
Dec 05 14:10:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-9e7b72dd-f2a3-41fa-a50f-4b2756e0f88e req-f8c6383c-deb4-427a-9f9c-40e736a0f7ff service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-unplugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9e7b72dd-f2a3-41fa-a50f-4b2756e0f88e req-f8c6383c-deb4-427a-9f9c-40e736a0f7ff service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9e7b72dd-f2a3-41fa-a50f-4b2756e0f88e req-f8c6383c-deb4-427a-9f9c-40e736a0f7ff service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9e7b72dd-f2a3-41fa-a50f-4b2756e0f88e req-f8c6383c-deb4-427a-9f9c-40e736a0f7ff service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-9e7b72dd-f2a3-41fa-a50f-4b2756e0f88e req-f8c6383c-deb4-427a-9f9c-40e736a0f7ff service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-unplugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:10:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-9e7b72dd-f2a3-41fa-a50f-4b2756e0f88e req-f8c6383c-deb4-427a-9f9c-40e736a0f7ff service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-unplugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:10:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Instance destroyed successfully.
Dec 05 14:10:51 user nova-compute[75233]: DEBUG nova.objects.instance [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'resources' on Instance uuid ce34db0a-bdc8-4379-8987-1ed437357311 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T14:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1899445961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1899445961',id=41,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXFwYzx8M05odD/u1teARHibQoH7IywQyT7UL/Vbj4kW9HjQg2zqv+V/6BJcoNQGTglRTQsVGLjCbMBYWDmrUlkr4voJ7cUdOJU/pIal5WS4/nGltwiR+NZNeq1ebLu7Q==',key_name='tempest-keypair-1905971800',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-iron191t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=ce34db0a-bdc8-4379-8987-1ed437357311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "address": "fa:16:3e:0c:58:cd", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe999fc-54", "ovs_interfaceid": "ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG os_vif [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffe999fc-54, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c62ef4f3-a008-416c-b64f-51d96fd89335) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:10:51 user nova-compute[75233]: INFO os_vif [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:58:cd,bridge_name='br-int',has_traffic_filtering=True,id=ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe999fc-54')
Dec 05 14:10:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Deleting instance files /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311_del
Dec 05 14:10:51 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Deletion of /opt/stack/data/nova/instances/ce34db0a-bdc8-4379-8987-1ed437357311_del complete
Dec 05 14:10:51 user nova-compute[75233]: INFO nova.compute.manager [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 05 14:10:51 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:10:51 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:10:52 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Took 0.71 seconds to deallocate network for instance.
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:52 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Deleted allocations for instance ce34db0a-bdc8-4379-8987-1ed437357311
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-560c6e6b-9ffe-4d63-9027-4bce830c4489 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "ce34db0a-bdc8-4379-8987-1ed437357311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] Acquiring lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] Lock "ce34db0a-bdc8-4379-8987-1ed437357311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:10:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] No waiting events found dispatching network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:10:52 user nova-compute[75233]: WARNING nova.compute.manager [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received unexpected event network-vif-plugged-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e for instance with vm_state deleted and task_state None.
Dec 05 14:10:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-1c72226d-0e2e-4154-b11f-43ed8f24fbeb req-42e619f8-ec42-42d8-8a64-5cbd732e90a1 service nova] [instance: ce34db0a-bdc8-4379-8987-1ed437357311] Received event network-vif-deleted-ffe999fc-5480-4aba-9dfd-3f1eb0c9d77e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:10:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:02 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:04 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:11:08 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=24.904010772705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:11:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:10 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:11:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:11:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:11:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:11:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:11:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:11:27 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:11:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:11:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:11:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:11:45 user nova-compute[75233]: INFO nova.compute.claims [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Claim successful on node user
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:11:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.policy [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '317f3e447b58464eb428e63ac23f80c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536eea64226a4234a4603ba5cf20cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:11:45 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Creating image(s)
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk 1073741824" returned: 0 in 0.054s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:45 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Cannot resize image /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Ensure instance console log exists: /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Successfully created port: fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Successfully updated port: fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG nova.compute.manager [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing instance network info cache due to event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:11:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance network_info: |[{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Start _get_guest_xml network_info=[{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:11:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:11:48 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1361081831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1361081831',id=44,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4YxPAtgpuU5p8mW5seeGaJTwkOB9So1CqdhkKFE9F5k0CwHJjdsNrhI2Wzp4VDS5mlpUgMw7OrRPVLdDBkK1CW8BUV5azh8pEYc+wnWIsCgmCtuq/eh4gQqaOQ5GKcDw==',key_name='tempest-keypair-1452970862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-ksked0v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=879b4c1d-9e8c-4fca-bb8f-80c794c2f835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'pci_devices' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:11:48 user nova-compute[75233]:   <uuid>879b4c1d-9e8c-4fca-bb8f-80c794c2f835</uuid>
Dec 05 14:11:48 user nova-compute[75233]:   <name>instance-0000002c</name>
Dec 05 14:11:48 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:11:48 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:11:48 user nova-compute[75233]:   <metadata>
Dec 05 14:11:48 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:11:48 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:11:48 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1361081831</nova:name>
Dec 05 14:11:48 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:11:48</nova:creationTime>
Dec 05 14:11:48 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:11:48 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:11:48 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:11:48 user nova-compute[75233]:       <nova:owner>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:user uuid="317f3e447b58464eb428e63ac23f80c6">tempest-AttachVolumeShelveTestJSON-1457724058-project-member</nova:user>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:project uuid="536eea64226a4234a4603ba5cf20cf1c">tempest-AttachVolumeShelveTestJSON-1457724058</nova:project>
Dec 05 14:11:48 user nova-compute[75233]:       </nova:owner>
Dec 05 14:11:48 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:11:48 user nova-compute[75233]:       <nova:ports>
Dec 05 14:11:48 user nova-compute[75233]:         <nova:port uuid="fe3629a5-3bef-49a7-bddd-7e3d28a70e59">
Dec 05 14:11:48 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 14:11:48 user nova-compute[75233]:         </nova:port>
Dec 05 14:11:48 user nova-compute[75233]:       </nova:ports>
Dec 05 14:11:48 user nova-compute[75233]:     </nova:instance>
Dec 05 14:11:48 user nova-compute[75233]:   </metadata>
Dec 05 14:11:48 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:11:48 user nova-compute[75233]:     <system>
Dec 05 14:11:48 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:11:48 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:11:48 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:11:48 user nova-compute[75233]:       <entry name="serial">879b4c1d-9e8c-4fca-bb8f-80c794c2f835</entry>
Dec 05 14:11:48 user nova-compute[75233]:       <entry name="uuid">879b4c1d-9e8c-4fca-bb8f-80c794c2f835</entry>
Dec 05 14:11:48 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:11:48 user nova-compute[75233]:     </system>
Dec 05 14:11:48 user nova-compute[75233]:   </sysinfo>
Dec 05 14:11:48 user nova-compute[75233]:   <os>
Dec 05 14:11:48 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:11:48 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:11:48 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:11:48 user nova-compute[75233]:   </os>
Dec 05 14:11:48 user nova-compute[75233]:   <features>
Dec 05 14:11:48 user nova-compute[75233]:     <acpi/>
Dec 05 14:11:48 user nova-compute[75233]:     <apic/>
Dec 05 14:11:48 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:11:48 user nova-compute[75233]:   </features>
Dec 05 14:11:48 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:11:48 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:11:48 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:11:48 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:11:48 user nova-compute[75233]:   </clock>
Dec 05 14:11:48 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:11:48 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:11:48 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:11:48 user nova-compute[75233]:   </cpu>
Dec 05 14:11:48 user nova-compute[75233]:   <devices>
Dec 05 14:11:48 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:11:48 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:11:48 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk"/>
Dec 05 14:11:48 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:11:48 user nova-compute[75233]:     </disk>
Dec 05 14:11:48 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:11:48 user nova-compute[75233]:       <mac address="fa:16:3e:22:1a:3f"/>
Dec 05 14:11:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:11:48 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:11:48 user nova-compute[75233]:       <target dev="tapfe3629a5-3b"/>
Dec 05 14:11:48 user nova-compute[75233]:     </interface>
Dec 05 14:11:48 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:11:48 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/console.log" append="off"/>
Dec 05 14:11:48 user nova-compute[75233]:     </serial>
Dec 05 14:11:48 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:11:48 user nova-compute[75233]:     <video>
Dec 05 14:11:48 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:11:48 user nova-compute[75233]:     </video>
Dec 05 14:11:48 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:11:48 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:11:48 user nova-compute[75233]:     </rng>
Dec 05 14:11:48 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:11:48 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:11:48 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:11:48 user nova-compute[75233]:     </memballoon>
Dec 05 14:11:48 user nova-compute[75233]:   </devices>
Dec 05 14:11:48 user nova-compute[75233]: </domain>
Dec 05 14:11:48 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1361081831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1361081831',id=44,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4YxPAtgpuU5p8mW5seeGaJTwkOB9So1CqdhkKFE9F5k0CwHJjdsNrhI2Wzp4VDS5mlpUgMw7OrRPVLdDBkK1CW8BUV5azh8pEYc+wnWIsCgmCtuq/eh4gQqaOQ5GKcDw==',key_name='tempest-keypair-1452970862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-ksked0v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=879b4c1d-9e8c-4fca-bb8f-80c794c2f835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG os_vif [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f164c20b-1dec-5b0f-885e-297c286950d7', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe3629a5-3b, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe3629a5-3b, col_values=(('qos', UUID('34ebbbe7-0b60-47f1-9a54-4a6b49ab8642')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe3629a5-3b, col_values=(('external_ids', {'iface-id': 'fe3629a5-3bef-49a7-bddd-7e3d28a70e59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:1a:3f', 'vm-uuid': '879b4c1d-9e8c-4fca-bb8f-80c794c2f835'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:48 user nova-compute[75233]: INFO os_vif [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b')
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No VIF found with MAC fa:16:3e:22:1a:3f, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updated VIF entry in instance network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG nova.network.neutron [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:11:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8cfce54b-936d-4fd9-9213-dba10c87561e req-b5c4f6e5-3139-4ab4-b01c-b3a5b9febacb service nova] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'flavor' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:50 user nova-compute[75233]: INFO nova.compute.manager [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Attaching volume 414e1128-b201-4274-a117-da5b651527c8 to /dev/vdb
Dec 05 14:11:50 user nova-compute[75233]: DEBUG os_brick.utils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de4f93-45ec-4685-adc7-b9b69f2c91c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c21a4ca-fae2-4435-8564-c07c2d3aef96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad15001-9777-4808-93f9-1373fbefec0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08faf425-bc0f-481b-aa81-3ad794b9d368]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-f9969890-3fd9-4630-aed5-3e7e15fe99fd req-e86ca80e-8ae8-4c36-be36-67384e882909 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f9969890-3fd9-4630-aed5-3e7e15fe99fd req-e86ca80e-8ae8-4c36-be36-67384e882909 service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f9969890-3fd9-4630-aed5-3e7e15fe99fd req-e86ca80e-8ae8-4c36-be36-67384e882909 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f9969890-3fd9-4630-aed5-3e7e15fe99fd req-e86ca80e-8ae8-4c36-be36-67384e882909 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG nova.compute.manager [req-f9969890-3fd9-4630-aed5-3e7e15fe99fd req-e86ca80e-8ae8-4c36-be36-67384e882909 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:11:50 user nova-compute[75233]: WARNING nova.compute.manager [req-f9969890-3fd9-4630-aed5-3e7e15fe99fd req-e86ca80e-8ae8-4c36-be36-67384e882909 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state building and task_state spawning.
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:11:50 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:11:50 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[323c3cf8-2ed2-45c5-a802-7b8146f0d69a]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG os_brick.utils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating existing volume attachment record: 33f6f79e-e7ca-4391-9921-b54631230e8e {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:11:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:11:52 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance spawned successfully.
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:11:52 user nova-compute[75233]: INFO nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Took 6.61 seconds to spawn the instance on the hypervisor.
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:11:52 user nova-compute[75233]: INFO nova.compute.manager [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Took 7.18 seconds to build instance.
Dec 05 14:11:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c38a0a70-1300-4419-9271-a1b4dc73d640 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.291s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-ae1874d4-1e03-443d-b93a-546e169debca req-ffbdf5df-8174-4a4c-85e7-f14918ac2475 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae1874d4-1e03-443d-b93a-546e169debca req-ffbdf5df-8174-4a4c-85e7-f14918ac2475 service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae1874d4-1e03-443d-b93a-546e169debca req-ffbdf5df-8174-4a4c-85e7-f14918ac2475 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae1874d4-1e03-443d-b93a-546e169debca req-ffbdf5df-8174-4a4c-85e7-f14918ac2475 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:11:52 user nova-compute[75233]: DEBUG nova.compute.manager [req-ae1874d4-1e03-443d-b93a-546e169debca req-ffbdf5df-8174-4a4c-85e7-f14918ac2475 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:11:52 user nova-compute[75233]: WARNING nova.compute.manager [req-ae1874d4-1e03-443d-b93a-546e169debca req-ffbdf5df-8174-4a4c-85e7-f14918ac2475 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state active and task_state None.
Dec 05 14:11:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhtaZwkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:11:59 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:11:59 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:11:59 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fef2c4-2771-4844-9fee-35292145fd57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:11:59 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2e7b40-bf26-4b34-bf93-6dc0bf510a94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8] added
Dec 05 14:11:59 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a837b2-80a3-4c02-b1c0-0729d31eae63]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a65fbb-f588-4a1a-ada0-78b750583f55]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhtaZwkA {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhtaZwkA" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[869621c3-e3ca-4d52-a5b1-e7a1f9b5fc73]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhtaZwkA'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a07da9-7568-43bf-b819-d282c5d4dda0]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0d1e2-177a-4084-9a06-d30854874783]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:11:59 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:11:59 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:11:59 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:11:59 user nova-compute[75233]: 
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0e7981-3ab2-470d-af37-91a9caa5c8ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260]
Dec 05 14:11:59 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260] successful.
Dec 05 14:11:59 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f43108-4f5b-4cd2-b907-82ff8974470f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f5108-57a2-4514-9f4e-0a68406e00fa]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:11:59 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:11:59 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d3c8a-669f-4120-99a1-e81a4c87fcdd]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:11:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhtaZwkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23334323133636333', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334323133636333', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'flavor' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:12:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:12:00 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:12:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:12:00 user nova-compute[75233]:   <serial>414e1128-b201-4274-a117-da5b651527c8</serial>
Dec 05 14:12:00 user nova-compute[75233]: </disk>
Dec 05 14:12:00 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:12:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:12:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:12:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] No VIF found with MAC fa:16:3e:66:1f:ff, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:12:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b9d80015-13ef-48ec-bec8-d58ff4429671 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.427s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:03 user nova-compute[75233]: DEBUG nova.compute.manager [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing instance network info cache due to event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:12:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:12:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:12:03 user nova-compute[75233]: DEBUG nova.network.neutron [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:12:04 user nova-compute[75233]: DEBUG nova.network.neutron [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated VIF entry in instance network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:12:04 user nova-compute[75233]: DEBUG nova.network.neutron [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:12:04 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-34321769-df9d-4073-8b55-756357a412e9 req-ba3a5294-0ab6-49d4-947a-a37ab7c0d557 service nova] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:12:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing instance network info cache due to event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated VIF entry in instance network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG nova.network.neutron [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bacf4518-e60f-43d7-b33e-253fcc49bc9c req-32b8ab20-ee06-4fe5-b3f6-aab05e034dd9 service nova] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:06 user nova-compute[75233]: INFO nova.compute.manager [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Rebooting instance
Dec 05 14:12:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:12:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:12:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:12:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:12:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:12:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:12:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:12:09 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=24.87329864501953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:12:09 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-d1df6917-e549-40b5-bf37-41f85a166405 req-f207ad20-aaea-494e-ac1c-23d1c516b3fb service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-unplugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1df6917-e549-40b5-bf37-41f85a166405 req-f207ad20-aaea-494e-ac1c-23d1c516b3fb service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1df6917-e549-40b5-bf37-41f85a166405 req-f207ad20-aaea-494e-ac1c-23d1c516b3fb service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d1df6917-e549-40b5-bf37-41f85a166405 req-f207ad20-aaea-494e-ac1c-23d1c516b3fb service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:10 user nova-compute[75233]: DEBUG nova.compute.manager [req-d1df6917-e549-40b5-bf37-41f85a166405 req-f207ad20-aaea-494e-ac1c-23d1c516b3fb service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-unplugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:12:10 user nova-compute[75233]: WARNING nova.compute.manager [req-d1df6917-e549-40b5-bf37-41f85a166405 req-f207ad20-aaea-494e-ac1c-23d1c516b3fb service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-unplugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state active and task_state reboot_started.
Dec 05 14:12:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:10 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance shutdown successfully.
Dec 05 14:12:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-7de43fd2-04be-4ecc-97a3-e37a07a5473a req-70a30dcf-3114-4a16-8b1f-5e7751311d78 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7de43fd2-04be-4ecc-97a3-e37a07a5473a req-70a30dcf-3114-4a16-8b1f-5e7751311d78 service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7de43fd2-04be-4ecc-97a3-e37a07a5473a req-70a30dcf-3114-4a16-8b1f-5e7751311d78 service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7de43fd2-04be-4ecc-97a3-e37a07a5473a req-70a30dcf-3114-4a16-8b1f-5e7751311d78 service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG nova.compute.manager [req-7de43fd2-04be-4ecc-97a3-e37a07a5473a req-70a30dcf-3114-4a16-8b1f-5e7751311d78 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:12:12 user nova-compute[75233]: WARNING nova.compute.manager [req-7de43fd2-04be-4ecc-97a3-e37a07a5473a req-70a30dcf-3114-4a16-8b1f-5e7751311d78 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state active and task_state reboot_started.
Dec 05 14:12:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:14 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance running successfully.
Dec 05 14:12:14 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance soft rebooted successfully.
Dec 05 14:12:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:12:14 user nova-compute[75233]: WARNING nova.compute.manager [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state active and task_state reboot_started.
Dec 05 14:12:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:12:14 user nova-compute[75233]: WARNING nova.compute.manager [req-dd2f92fe-1c95-4169-bbf8-a74335a3d33a req-a29e34dd-70c9-43b5-a98a-d4cc29df01cf service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state active and task_state reboot_started.
Dec 05 14:12:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c61f816d-2c48-406e-b29e-380f14e6c3c0 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.398s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "28aa8a80-6239-4645-a805-1f87c41b6791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:12:15 user nova-compute[75233]: INFO nova.compute.claims [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Claim successful on node user
Dec 05 14:12:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:12:15 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:12:15 user nova-compute[75233]: DEBUG nova.policy [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0980778b5e4b6999590c1f311a1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cfadfed75341e8aa2e5b4f87e962d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:12:15 user nova-compute[75233]: INFO nova.virt.block_device [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Booting with volume snapshot f8a24e67-b60a-4f12-bbe8-5edd30a66141 at /dev/vda
Dec 05 14:12:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Successfully created port: 90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Successfully updated port: 90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "refresh_cache-28aa8a80-6239-4645-a805-1f87c41b6791" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquired lock "refresh_cache-28aa8a80-6239-4645-a805-1f87c41b6791" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-changed-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Refreshing instance network info cache due to event network-changed-90e958c1-e824-4d8e-8de7-3ec2ed0da182. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] Acquiring lock "refresh_cache-28aa8a80-6239-4645-a805-1f87c41b6791" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Updating instance_info_cache with network_info: [{"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Releasing lock "refresh_cache-28aa8a80-6239-4645-a805-1f87c41b6791" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Instance network_info: |[{"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] Acquired lock "refresh_cache-28aa8a80-6239-4645-a805-1f87c41b6791" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Refreshing network info cache for port 90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Updated VIF entry in instance network info cache for port 90e958c1-e824-4d8e-8de7-3ec2ed0da182. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG nova.network.neutron [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Updating instance_info_cache with network_info: [{"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:12:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5581044e-acc2-4015-9060-53965e46add7 req-271274cf-a030-47c5-8f53-1823d1efab2a service nova] Releasing lock "refresh_cache-28aa8a80-6239-4645-a805-1f87c41b6791" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:12:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG os_brick.utils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0979af2d-80c8-4dc5-812f-cae5229c4e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dabc1b-b304-4d58-8f4a-f53eb1065b3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5cf8ea-ceb2-4a19-a21d-bb92df711851]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf6d8b-4aec-422f-8474-71d3e88e7dd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:12:21 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:12:21 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55483b3-09ec-45c0-bda8-29fb52d6f265]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG os_brick.utils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:12:21 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Updating existing volume attachment record: e34f84c0-70bb-449c-ae4c-580c6fabe803 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:12:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Skipping network cache update for instance because it is Building. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:12:28 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:12:29 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:12:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:12:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:12:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Creating image(s)
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Ensure instance console log exists: /opt/stack/data/nova/instances/28aa8a80-6239-4645-a805-1f87c41b6791/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Start _get_guest_xml network_info=[{"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'euAiEFqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28aa8a80-6239-4645-a805-1f87c41b6791', 'attached_at': '', 'detached_at': '', 'volume_id': '0fc56060-734b-4518-b33a-2e70f7a6cd49', 'serial': '0fc56060-734b-4518-b33a-2e70f7a6cd49'}, 'delete_on_termination': True, 'attachment_id': 'e34f84c0-70bb-449c-ae4c-580c6fabe803', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:12:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:12:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'euAiEFqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:12:30 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:12:30 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:12:30 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dcae6e-04bb-4bde-b6d4-77dbce00c8fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:12:30 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5799145-76d4-4346-b9ab-14e69b0c6a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49] added
Dec 05 14:12:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fcefee-6a06-4014-a093-642f9a19fbf6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[648c5354-2613-4d70-9d2b-18f1c3d44238]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v euAiEFqT {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v euAiEFqT" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17e6fe6-7aa1-4a57-8c77-890b8581d10a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'euAiEFqT'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[117a8c44-9aae-4b96-8596-8c61b0a07f1a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[533cc735-5436-41e9-9dbd-2fcdf56460e4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:12:31 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:12:31 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86de648-de95-42ee-8657-7a428d510417]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260]
Dec 05 14:12:31 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260] successful.
Dec 05 14:12:31 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8bf140-e7ed-4bdc-87f0-295594a1fd0f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a97abc-e20f-49f8-a7a3-6d82cf2e6122]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:12:31 user nova-compute[75233]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 (non-flash)
Dec 05 14:12:31 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:12:31 user nova-compute[75233]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 (non-flash)
Dec 05 14:12:31 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea658b1b-0900-494e-9a99-897bcb6aa13e]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:12:31 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'euAiEFqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23565343761626163', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343761626163', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-941216479',display_name='tempest-TestVolumeBootPattern-server-941216479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-941216479',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-9scvcrob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:12:16Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=28aa8a80-6239-4645-a805-1f87c41b6791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'pci_devices' on Instance uuid 28aa8a80-6239-4645-a805-1f87c41b6791 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:12:32 user nova-compute[75233]:   <uuid>28aa8a80-6239-4645-a805-1f87c41b6791</uuid>
Dec 05 14:12:32 user nova-compute[75233]:   <name>instance-0000002d</name>
Dec 05 14:12:32 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:12:32 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:12:32 user nova-compute[75233]:   <metadata>
Dec 05 14:12:32 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:12:32 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:12:32 user nova-compute[75233]:       <nova:name>tempest-TestVolumeBootPattern-server-941216479</nova:name>
Dec 05 14:12:32 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:12:30</nova:creationTime>
Dec 05 14:12:32 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:12:32 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:12:32 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:12:32 user nova-compute[75233]:       <nova:owner>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:user uuid="bc0980778b5e4b6999590c1f311a1c1d">tempest-TestVolumeBootPattern-1094285123-project-member</nova:user>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:project uuid="c9cfadfed75341e8aa2e5b4f87e962d9">tempest-TestVolumeBootPattern-1094285123</nova:project>
Dec 05 14:12:32 user nova-compute[75233]:       </nova:owner>
Dec 05 14:12:32 user nova-compute[75233]:       <nova:ports>
Dec 05 14:12:32 user nova-compute[75233]:         <nova:port uuid="90e958c1-e824-4d8e-8de7-3ec2ed0da182">
Dec 05 14:12:32 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 14:12:32 user nova-compute[75233]:         </nova:port>
Dec 05 14:12:32 user nova-compute[75233]:       </nova:ports>
Dec 05 14:12:32 user nova-compute[75233]:     </nova:instance>
Dec 05 14:12:32 user nova-compute[75233]:   </metadata>
Dec 05 14:12:32 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:12:32 user nova-compute[75233]:     <system>
Dec 05 14:12:32 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:12:32 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:12:32 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:12:32 user nova-compute[75233]:       <entry name="serial">28aa8a80-6239-4645-a805-1f87c41b6791</entry>
Dec 05 14:12:32 user nova-compute[75233]:       <entry name="uuid">28aa8a80-6239-4645-a805-1f87c41b6791</entry>
Dec 05 14:12:32 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:12:32 user nova-compute[75233]:     </system>
Dec 05 14:12:32 user nova-compute[75233]:   </sysinfo>
Dec 05 14:12:32 user nova-compute[75233]:   <os>
Dec 05 14:12:32 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:12:32 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:12:32 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:12:32 user nova-compute[75233]:   </os>
Dec 05 14:12:32 user nova-compute[75233]:   <features>
Dec 05 14:12:32 user nova-compute[75233]:     <acpi/>
Dec 05 14:12:32 user nova-compute[75233]:     <apic/>
Dec 05 14:12:32 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:12:32 user nova-compute[75233]:   </features>
Dec 05 14:12:32 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:12:32 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:12:32 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:12:32 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:12:32 user nova-compute[75233]:   </clock>
Dec 05 14:12:32 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:12:32 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:12:32 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:12:32 user nova-compute[75233]:   </cpu>
Dec 05 14:12:32 user nova-compute[75233]:   <devices>
Dec 05 14:12:32 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:12:32 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:12:32 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 14:12:32 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:12:32 user nova-compute[75233]:       <serial>0fc56060-734b-4518-b33a-2e70f7a6cd49</serial>
Dec 05 14:12:32 user nova-compute[75233]:     </disk>
Dec 05 14:12:32 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:12:32 user nova-compute[75233]:       <mac address="fa:16:3e:e4:70:8a"/>
Dec 05 14:12:32 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:12:32 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:12:32 user nova-compute[75233]:       <target dev="tap90e958c1-e8"/>
Dec 05 14:12:32 user nova-compute[75233]:     </interface>
Dec 05 14:12:32 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:12:32 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/28aa8a80-6239-4645-a805-1f87c41b6791/console.log" append="off"/>
Dec 05 14:12:32 user nova-compute[75233]:     </serial>
Dec 05 14:12:32 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:12:32 user nova-compute[75233]:     <video>
Dec 05 14:12:32 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:12:32 user nova-compute[75233]:     </video>
Dec 05 14:12:32 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:12:32 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:12:32 user nova-compute[75233]:     </rng>
Dec 05 14:12:32 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:12:32 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:12:32 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:12:32 user nova-compute[75233]:     </memballoon>
Dec 05 14:12:32 user nova-compute[75233]:   </devices>
Dec 05 14:12:32 user nova-compute[75233]: </domain>
Dec 05 14:12:32 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-941216479',display_name='tempest-TestVolumeBootPattern-server-941216479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-941216479',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-9scvcrob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:12:16Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=28aa8a80-6239-4645-a805-1f87c41b6791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG os_vif [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27c71837-f675-51e9-9f35-da4800e51c95', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e958c1-e8, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90e958c1-e8, col_values=(('qos', UUID('bef8e609-b1ed-4a7d-9a00-8973a07072c4')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90e958c1-e8, col_values=(('external_ids', {'iface-id': '90e958c1-e824-4d8e-8de7-3ec2ed0da182', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:70:8a', 'vm-uuid': '28aa8a80-6239-4645-a805-1f87c41b6791'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:32 user nova-compute[75233]: INFO os_vif [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8')
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:12:32 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No VIF found with MAC fa:16:3e:e4:70:8a, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b5770eb-d73c-4abc-bde0-9a680ec68cda req-9cadf55f-2836-4796-87dc-55c6918c1b2e service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b5770eb-d73c-4abc-bde0-9a680ec68cda req-9cadf55f-2836-4796-87dc-55c6918c1b2e service nova] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b5770eb-d73c-4abc-bde0-9a680ec68cda req-9cadf55f-2836-4796-87dc-55c6918c1b2e service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8b5770eb-d73c-4abc-bde0-9a680ec68cda req-9cadf55f-2836-4796-87dc-55c6918c1b2e service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-8b5770eb-d73c-4abc-bde0-9a680ec68cda req-9cadf55f-2836-4796-87dc-55c6918c1b2e service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] No waiting events found dispatching network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:12:33 user nova-compute[75233]: WARNING nova.compute.manager [req-8b5770eb-d73c-4abc-bde0-9a680ec68cda req-9cadf55f-2836-4796-87dc-55c6918c1b2e service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received unexpected event network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 for instance with vm_state building and task_state spawning.
Dec 05 14:12:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:12:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Instance spawned successfully.
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:12:35 user nova-compute[75233]: INFO nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Took 4.84 seconds to spawn the instance on the hypervisor.
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-7e55374b-580b-48da-9782-e5ec52314eac req-9650d0de-eb94-44f3-85aa-6d7b9f9963ef service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7e55374b-580b-48da-9782-e5ec52314eac req-9650d0de-eb94-44f3-85aa-6d7b9f9963ef service nova] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7e55374b-580b-48da-9782-e5ec52314eac req-9650d0de-eb94-44f3-85aa-6d7b9f9963ef service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7e55374b-580b-48da-9782-e5ec52314eac req-9650d0de-eb94-44f3-85aa-6d7b9f9963ef service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-7e55374b-580b-48da-9782-e5ec52314eac req-9650d0de-eb94-44f3-85aa-6d7b9f9963ef service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] No waiting events found dispatching network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:12:35 user nova-compute[75233]: WARNING nova.compute.manager [req-7e55374b-580b-48da-9782-e5ec52314eac req-9650d0de-eb94-44f3-85aa-6d7b9f9963ef service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received unexpected event network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 for instance with vm_state active and task_state None.
Dec 05 14:12:35 user nova-compute[75233]: INFO nova.compute.manager [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Took 20.34 seconds to build instance.
Dec 05 14:12:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c68aa1f9-5faf-4d98-bbb9-5f327f62213f tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "28aa8a80-6239-4645-a805-1f87c41b6791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.437s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:12:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:12:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:05 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:13:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:13:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:13:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:13:09 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=24.86107635498047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 28aa8a80-6239-4645-a805-1f87c41b6791 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:13:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:13:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:13:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:13:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:13:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:13:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:13:29 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:13:30 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:13:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:13:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:13:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:13:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:13:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:13:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:13:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:13:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing instance network info cache due to event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:13:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:13:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:13:35 user nova-compute[75233]: DEBUG nova.network.neutron [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:13:35 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updated VIF entry in instance network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:13:36 user nova-compute[75233]: DEBUG nova.network.neutron [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:13:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-db987cd5-14aa-4d79-b061-ee68c1e2313b req-09bf65c4-fb58-4b71-a44a-06e9370cf09b service nova] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:13:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:39 user nova-compute[75233]: INFO nova.compute.manager [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Shelving
Dec 05 14:13:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-0b289f71-cf25-417e-907d-982ef2b7051d req-296e3c99-fbf9-4ddb-ace9-cd8787e83cf4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0b289f71-cf25-417e-907d-982ef2b7051d req-296e3c99-fbf9-4ddb-ace9-cd8787e83cf4 service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0b289f71-cf25-417e-907d-982ef2b7051d req-296e3c99-fbf9-4ddb-ace9-cd8787e83cf4 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0b289f71-cf25-417e-907d-982ef2b7051d req-296e3c99-fbf9-4ddb-ace9-cd8787e83cf4 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:13:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-0b289f71-cf25-417e-907d-982ef2b7051d req-296e3c99-fbf9-4ddb-ace9-cd8787e83cf4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:13:39 user nova-compute[75233]: WARNING nova.compute.manager [req-0b289f71-cf25-417e-907d-982ef2b7051d req-296e3c99-fbf9-4ddb-ace9-cd8787e83cf4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state active and task_state shelving.
Dec 05 14:13:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance destroyed successfully.
Dec 05 14:13:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Beginning cold snapshot process
Dec 05 14:13:40 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:13:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk /opt/stack/data/nova/instances/snapshots/tmpf9sc_ql4/89e36f6bd1bf48afa9ca3b860405c947 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:13:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk /opt/stack/data/nova/instances/snapshots/tmpf9sc_ql4/89e36f6bd1bf48afa9ca3b860405c947" returned: 0 in 0.360s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:13:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Snapshot extracted, beginning image upload
Dec 05 14:13:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-8e39859f-e13b-4b6f-8c4a-7457aa2cfe5b req-3e18ca7e-dab4-48f1-8eac-0d1493e06f0b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:13:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8e39859f-e13b-4b6f-8c4a-7457aa2cfe5b req-3e18ca7e-dab4-48f1-8eac-0d1493e06f0b service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8e39859f-e13b-4b6f-8c4a-7457aa2cfe5b req-3e18ca7e-dab4-48f1-8eac-0d1493e06f0b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8e39859f-e13b-4b6f-8c4a-7457aa2cfe5b req-3e18ca7e-dab4-48f1-8eac-0d1493e06f0b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:13:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-8e39859f-e13b-4b6f-8c4a-7457aa2cfe5b req-3e18ca7e-dab4-48f1-8eac-0d1493e06f0b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:13:41 user nova-compute[75233]: WARNING nova.compute.manager [req-8e39859f-e13b-4b6f-8c4a-7457aa2cfe5b req-3e18ca7e-dab4-48f1-8eac-0d1493e06f0b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state active and task_state shelving_image_uploading.
Dec 05 14:13:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Snapshot image upload complete
Dec 05 14:13:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:13:43 user nova-compute[75233]: INFO nova.compute.manager [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Shelve offloading
Dec 05 14:13:43 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance destroyed successfully.
Dec 05 14:13:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:13:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:13:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:13:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:13:43 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:13:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:13:44 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance destroyed successfully.
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'resources' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1361081831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1361081831',id=44,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4YxPAtgpuU5p8mW5seeGaJTwkOB9So1CqdhkKFE9F5k0CwHJjdsNrhI2Wzp4VDS5mlpUgMw7OrRPVLdDBkK1CW8BUV5azh8pEYc+wnWIsCgmCtuq/eh4gQqaOQ5GKcDw==',key_name='tempest-keypair-1452970862',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-ksked0v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member',shelved_at='2023-12-05T14:13:43.183145',shelved_host='user',shelved_image_id='fbb2ffa6-3a84-4063-b31b-cba23d94ba4f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=879b4c1d-9e8c-4fca-bb8f-80c794c2f835,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG os_vif [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe3629a5-3b, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.compute.manager [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing instance network info cache due to event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.network.neutron [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34ebbbe7-0b60-47f1-9a54-4a6b49ab8642) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:13:44 user nova-compute[75233]: INFO os_vif [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b')
Dec 05 14:13:44 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Deleting instance files /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835_del
Dec 05 14:13:44 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Deletion of /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835_del complete
Dec 05 14:13:44 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Deleted allocations for instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'numa_topology' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.objects.base [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<879b4c1d-9e8c-4fca-bb8f-80c794c2f835> lazy-loaded attributes: resources,numa_topology {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.network.neutron [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updated VIF entry in instance network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG nova.network.neutron [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fbd225b1-e7a1-45ad-aa1e-7831b4ea11c6 tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.276s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:13:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8306dff4-6da7-43bd-b1ae-444e4dd68676 req-927df023-e0de-4785-a2c0-068f8f0ad4e0 service nova] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:13:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:13:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:13:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing instance network info cache due to event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:13:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:13:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:13:58 user nova-compute[75233]: DEBUG nova.network.neutron [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated VIF entry in instance network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c9d4fb15-ae5b-40c1-b578-3b6d739e72f8 req-f3ad306b-9a44-4a79-a635-2c9a9d8da325 service nova] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing instance network info cache due to event network-changed-d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Refreshing network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:13:59 user nova-compute[75233]: INFO nova.compute.manager [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Detaching volume 414e1128-b201-4274-a117-da5b651527c8
Dec 05 14:13:59 user nova-compute[75233]: INFO nova.virt.block_device [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Attempting to driver detach volume 414e1128-b201-4274-a117-da5b651527c8 from mountpoint /dev/vdb
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Attempting to detach device vdb from instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:13:59 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:13:59 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:13:59 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:13:59 user nova-compute[75233]:   <serial>414e1128-b201-4274-a117-da5b651527c8</serial>
Dec 05 14:13:59 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:13:59 user nova-compute[75233]: </disk>
Dec 05 14:13:59 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:13:59 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully detached device vdb from instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf from the persistent domain config.
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:13:59 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:13:59 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:13:59 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:13:59 user nova-compute[75233]:   <serial>414e1128-b201-4274-a117-da5b651527c8</serial>
Dec 05 14:13:59 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:13:59 user nova-compute[75233]: </disk>
Dec 05 14:13:59 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:13:59 user nova-compute[75233]: DEBUG nova.network.neutron [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated VIF entry in instance network info cache for port d8b2be0b-938e-4c44-ad94-b801ad0623d1. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:14:00 user nova-compute[75233]: DEBUG nova.network.neutron [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:14:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b41526ea-fb68-4cae-9d2c-d90e3ab7292f req-640aaa0c-bcca-4f46-8f6d-14766d1b1440 service nova] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:14:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:14:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:04 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "28aa8a80-6239-4645-a805-1f87c41b6791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:06 user nova-compute[75233]: INFO nova.compute.manager [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Terminating instance
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-fc22fdaf-5742-48bb-8104-58f12f2e8093 req-8fa1513e-ce8a-47e7-9be5-b7bcd98731fd service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-vif-unplugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fc22fdaf-5742-48bb-8104-58f12f2e8093 req-8fa1513e-ce8a-47e7-9be5-b7bcd98731fd service nova] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fc22fdaf-5742-48bb-8104-58f12f2e8093 req-8fa1513e-ce8a-47e7-9be5-b7bcd98731fd service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fc22fdaf-5742-48bb-8104-58f12f2e8093 req-8fa1513e-ce8a-47e7-9be5-b7bcd98731fd service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-fc22fdaf-5742-48bb-8104-58f12f2e8093 req-8fa1513e-ce8a-47e7-9be5-b7bcd98731fd service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] No waiting events found dispatching network-vif-unplugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.compute.manager [req-fc22fdaf-5742-48bb-8104-58f12f2e8093 req-8fa1513e-ce8a-47e7-9be5-b7bcd98731fd service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-vif-unplugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:06 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Instance destroyed successfully.
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.objects.instance [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'resources' on Instance uuid 28aa8a80-6239-4645-a805-1f87c41b6791 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-941216479',display_name='tempest-TestVolumeBootPattern-server-941216479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-941216479',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-9scvcrob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:12:36Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=28aa8a80-6239-4645-a805-1f87c41b6791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "address": "fa:16:3e:e4:70:8a", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e958c1-e8", "ovs_interfaceid": "90e958c1-e824-4d8e-8de7-3ec2ed0da182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_vif [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e958c1-e8, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bef8e609-b1ed-4a7d-9a00-8973a07072c4) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:06 user nova-compute[75233]: INFO os_vif [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:70:8a,bridge_name='br-int',has_traffic_filtering=True,id=90e958c1-e824-4d8e-8de7-3ec2ed0da182,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e958c1-e8')
Dec 05 14:14:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'euAiEFqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:14:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538b8a3-2824-47c2-ab35-e90241b6a3e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:14:06 user nova-compute[75233]: No targets found.
Dec 05 14:14:06 user nova-compute[75233]: iSNS:
Dec 05 14:14:06 user nova-compute[75233]: No targets found.
Dec 05 14:14:06 user nova-compute[75233]: STATIC:
Dec 05 14:14:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8
Dec 05 14:14:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:14:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:14:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49
Dec 05 14:14:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:14:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:14:06 user nova-compute[75233]: FIRMWARE:
Dec 05 14:14:06 user nova-compute[75233]: No targets found.
Dec 05 14:14:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:14:06 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:14:06 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c919891-9d92-4b5a-b923-69d69560b819]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eae72b-91ff-4574-b91c-be14487fca99]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:14:06 user nova-compute[75233]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 (non-flash)
Dec 05 14:14:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:14:06 user nova-compute[75233]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 (non-flash)
Dec 05 14:14:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586a9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80da2de-2bb9-498c-9cd8-87d47ae323a6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83feee9-aa21-4d2a-b281-fbc5ede1cabe]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:14:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e686c-fa2c-447e-b0b5-a26e7538e81e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b2ed20-5056-4c0a-b427-6f1613db8d30]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2980d678', '/dev/disk/by-id/scsi-1SCST_BIO2980d678-5e47abaca57e2b65', '/dev/disk/by-id/scsi-23565343761626163') {{(pid=86205) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e3648f-af2b-4614-a612-bd23179be311]: (4, None) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce842cc-08be-4477-a9c8-ed79219324c4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd63b4-fd5f-4ba9-a64f-7244198fe9a1]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260]
Dec 05 14:14:07 user nova-compute[75233]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49, portal: 172.16.0.220,3260] successful.
Dec 05 14:14:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc56060-734b-4518-b33a-2e70f7a6cd49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[366797aa-0040-47f8-bb66-e78e9a758488]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== disconnect_volume: return (334ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:14:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Deleting instance files /opt/stack/data/nova/instances/28aa8a80-6239-4645-a805-1f87c41b6791_del
Dec 05 14:14:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Deletion of /opt/stack/data/nova/instances/28aa8a80-6239-4645-a805-1f87c41b6791_del complete
Dec 05 14:14:07 user nova-compute[75233]: INFO nova.compute.manager [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:07 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:14:07 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Took 0.49 seconds to deallocate network for instance.
Dec 05 14:14:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-706920f2-154d-4ace-903f-651e7cb13606 req-bae747d4-f493-48b5-a815-be7ff6aeac0d service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-vif-deleted-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-72ceeee5-bbb3-4f7f-852a-d268b077d542 req-58c137a7-59a9-4f58-8277-2caf9999e1f8 service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received event network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-72ceeee5-bbb3-4f7f-852a-d268b077d542 req-58c137a7-59a9-4f58-8277-2caf9999e1f8 service nova] Acquiring lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-72ceeee5-bbb3-4f7f-852a-d268b077d542 req-58c137a7-59a9-4f58-8277-2caf9999e1f8 service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-72ceeee5-bbb3-4f7f-852a-d268b077d542 req-58c137a7-59a9-4f58-8277-2caf9999e1f8 service nova] Lock "28aa8a80-6239-4645-a805-1f87c41b6791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-72ceeee5-bbb3-4f7f-852a-d268b077d542 req-58c137a7-59a9-4f58-8277-2caf9999e1f8 service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] No waiting events found dispatching network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:14:08 user nova-compute[75233]: WARNING nova.compute.manager [req-72ceeee5-bbb3-4f7f-852a-d268b077d542 req-58c137a7-59a9-4f58-8277-2caf9999e1f8 service nova] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Received unexpected event network-vif-plugged-90e958c1-e824-4d8e-8de7-3ec2ed0da182 for instance with vm_state active and task_state deleting.
Dec 05 14:14:08 user nova-compute[75233]: INFO nova.compute.manager [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Took 0.78 seconds to detach 1 volumes for instance.
Dec 05 14:14:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 28aa8a80-6239-4645-a805-1f87c41b6791] Deleting volume: 0fc56060-734b-4518-b33a-2e70f7a6cd49 {{(pid=75233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:14:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:08 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Deleted allocations for instance 28aa8a80-6239-4645-a805-1f87c41b6791
Dec 05 14:14:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-d7d30bd8-4e18-4ac5-9154-624b33b79321 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "28aa8a80-6239-4645-a805-1f87c41b6791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:11 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:14:11 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=24.838851928710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:14:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:20 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf is timed out.
Dec 05 14:14:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully detached device vdb from instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf from the live domain config.
Dec 05 14:14:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhtaZwkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:14:20 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3206ad4-d85e-4b15-b953-9b3990ff583d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:14:20 user nova-compute[75233]: No targets found.
Dec 05 14:14:20 user nova-compute[75233]: iSNS:
Dec 05 14:14:20 user nova-compute[75233]: No targets found.
Dec 05 14:14:20 user nova-compute[75233]: STATIC:
Dec 05 14:14:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8
Dec 05 14:14:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:14:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:14:20 user nova-compute[75233]: FIRMWARE:
Dec 05 14:14:20 user nova-compute[75233]: No targets found.
Dec 05 14:14:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:14:20 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:14:20 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42dacc-e8ee-4dba-b7a9-cc6570435a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d54f3f-04d6-44dd-9fe5-98d8de4e4c7e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:14:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 (non-flash)
Dec 05 14:14:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f345379a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ece137-77a0-403e-895f-a24653faead4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13fe131-6756-43f8-9bb0-c9eb5fc0f74a]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd26e6b0-dd2b-4ca7-824f-4bc1dc6b94d6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd81f5c-2b61-4330-abcc-e1674f15ec50]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbf9180-7528-477a-be69-73d232cb94d3]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc6bb3-cc74-42cc-ba0b-6a34997ca08f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260]
Dec 05 14:14:20 user nova-compute[75233]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8, portal: 172.16.0.220,3260] successful.
Dec 05 14:14:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414e1128-b201-4274-a117-da5b651527c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f8f2e-7d84-4b8f-81b0-a4c7bcaa064e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] <== disconnect_volume: return (281ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:14:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:14:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'flavor' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:14:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-597a64b9-ecc8-4b63-af25-40b9c4071622 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:14:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [{"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:14:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-dfe66be3-ee6e-4e42-baa9-9ce598b710bf" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:14:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Verify base images {{(pid=75233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Image id 1a365a74-8c99-46ad-8ce3-c93d4f68fdc6 yields fingerprint e329e75c1e7ace0ad8055bb1c32fc95a03802d7b {{(pid=75233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] image 1a365a74-8c99-46ad-8ce3-c93d4f68fdc6 at (/opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b): checking
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] image 1a365a74-8c99-46ad-8ce3-c93d4f68fdc6 at (/opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b): image is in use {{(pid=75233) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] dfe66be3-ee6e-4e42-baa9-9ce598b710bf is a valid instance name {{(pid=75233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] dfe66be3-ee6e-4e42-baa9-9ce598b710bf has a disk file {{(pid=75233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf is backed by e329e75c1e7ace0ad8055bb1c32fc95a03802d7b {{(pid=75233) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48
Dec 05 14:14:34 user nova-compute[75233]: WARNING nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Active base files: /opt/stack/data/nova/instances/_base/e329e75c1e7ace0ad8055bb1c32fc95a03802d7b
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Removable base files: /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3 /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0 /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592 /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4 /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48 /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a889c83f8a4eb6dd2c38b8711fd985b35c1bc2d3
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/369bead66d7979431fdd95be2117d41784533eb0
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a960499cf7e87fb52f26ff3b6a57da40130b907f
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8e28a4357370f3df1e221cb294e16b243da8592
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/246645e789e2a2ad29aa90f0eaaaaa215ce0f1a4
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aaed931f4796586495d61fceb2105c0be77afd48
Dec 05 14:14:34 user nova-compute[75233]: INFO nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4147269ee60a4b87fad1d18b7d4342d3f0507ce7
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Verification complete {{(pid=75233) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Verify swap images {{(pid=75233) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 05 14:14:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.imagecache [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Verify ephemeral images {{(pid=75233) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 05 14:14:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:14:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:14:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:14:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:54 user nova-compute[75233]: INFO nova.compute.manager [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Terminating instance
Dec 05 14:14:54 user nova-compute[75233]: DEBUG nova.compute.manager [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-beb18cd6-1d44-413f-9e5f-08a8bacbc0e0 req-56b31b0c-aecd-40c6-832b-1ad678f8eddd service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-unplugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-beb18cd6-1d44-413f-9e5f-08a8bacbc0e0 req-56b31b0c-aecd-40c6-832b-1ad678f8eddd service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-beb18cd6-1d44-413f-9e5f-08a8bacbc0e0 req-56b31b0c-aecd-40c6-832b-1ad678f8eddd service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-beb18cd6-1d44-413f-9e5f-08a8bacbc0e0 req-56b31b0c-aecd-40c6-832b-1ad678f8eddd service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-beb18cd6-1d44-413f-9e5f-08a8bacbc0e0 req-56b31b0c-aecd-40c6-832b-1ad678f8eddd service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-unplugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:14:54 user nova-compute[75233]: DEBUG nova.compute.manager [req-beb18cd6-1d44-413f-9e5f-08a8bacbc0e0 req-56b31b0c-aecd-40c6-832b-1ad678f8eddd service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-unplugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Instance destroyed successfully.
Dec 05 14:14:55 user nova-compute[75233]: DEBUG nova.objects.instance [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lazy-loading 'resources' on Instance uuid dfe66be3-ee6e-4e42-baa9-9ce598b710bf {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:09:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1536377839',display_name='tempest-TestMinimumBasicScenario-server-1536377839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1536377839',id=43,image_ref='1a365a74-8c99-46ad-8ce3-c93d4f68fdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsXmvGyro5uxlsG5bMlfWjIPiNFZMOyps9WbUMmW+M6GBbzfE5hdEfBBVQePtxtnUj326kUcK3NU5d8B3qiqQGwlkljhEmJ19kcidQ7bEYXmhBELULzt0Y5H0pr/8OYsQ==',key_name='tempest-TestMinimumBasicScenario-1495418633',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd1d061238f6482c9a10d751ab1d2abd',ramdisk_id='',reservation_id='r-lv33kvbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1a365a74-8c99-46ad-8ce3-c93d4f68fdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-235565151',owner_user_name='tempest-TestMinimumBasicScenario-235565151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:12:14Z,user_data=None,user_id='6b3ba7c68eeb411a8c3cf77748216e65',uuid=dfe66be3-ee6e-4e42-baa9-9ce598b710bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converting VIF {"id": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "address": "fa:16:3e:66:1f:ff", "network": {"id": "09474228-9599-4bab-a643-368f9de43f1a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1056378461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd1d061238f6482c9a10d751ab1d2abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b2be0b-93", "ovs_interfaceid": "d8b2be0b-938e-4c44-ad94-b801ad0623d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG os_vif [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8b2be0b-93, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd743158-6767-4128-825a-c7027341dac9) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:14:55 user nova-compute[75233]: INFO os_vif [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:1f:ff,bridge_name='br-int',has_traffic_filtering=True,id=d8b2be0b-938e-4c44-ad94-b801ad0623d1,network=Network(09474228-9599-4bab-a643-368f9de43f1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b2be0b-93')
Dec 05 14:14:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Deleting instance files /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf_del
Dec 05 14:14:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Deletion of /opt/stack/data/nova/instances/dfe66be3-ee6e-4e42-baa9-9ce598b710bf_del complete
Dec 05 14:14:55 user nova-compute[75233]: INFO nova.compute.manager [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 14:14:55 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:14:55 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:14:56 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Took 0.57 seconds to deallocate network for instance.
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:56 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Deleted allocations for instance dfe66be3-ee6e-4e42-baa9-9ce598b710bf
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-3f280676-306d-4d3b-bf3c-8ab3343a3e02 tempest-TestMinimumBasicScenario-235565151 tempest-TestMinimumBasicScenario-235565151-project-member] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] Acquiring lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] Lock "dfe66be3-ee6e-4e42-baa9-9ce598b710bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:14:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] No waiting events found dispatching network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:14:56 user nova-compute[75233]: WARNING nova.compute.manager [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received unexpected event network-vif-plugged-d8b2be0b-938e-4c44-ad94-b801ad0623d1 for instance with vm_state deleted and task_state None.
Dec 05 14:14:56 user nova-compute[75233]: DEBUG nova.compute.manager [req-8a08bfd6-4cf7-40e1-86c6-d82a78ec27f3 req-b1e982ee-1c46-463d-8343-e1bd850602d7 service nova] [instance: dfe66be3-ee6e-4e42-baa9-9ce598b710bf] Received event network-vif-deleted-d8b2be0b-938e-4c44-ad94-b801ad0623d1 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:15:11 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:15:11 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:15:11 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=24.86574935913086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:15:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "6ac15324-7335-4524-a93d-b51bf216d6df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:15:15 user nova-compute[75233]: INFO nova.compute.claims [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Claim successful on node user
Dec 05 14:15:15 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:15:15 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:15:16 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.policy [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0980778b5e4b6999590c1f311a1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cfadfed75341e8aa2e5b4f87e962d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:15:16 user nova-compute[75233]: INFO nova.virt.block_device [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Booting with volume 08725345-1042-4a30-bd59-6e1260b3c824 at /dev/vda
Dec 05 14:15:16 user nova-compute[75233]: DEBUG os_brick.utils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb905728-4277-4b2e-97c0-65f6ba747e79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd49345-c07b-4add-a8a1-5cf75da72825]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f500e84-bdf0-41af-8a47-648519591b33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea37fa91-bd48-4a73-a899-a4bc6eb73b8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:15:16 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f3c8f-c35c-4697-a241-09665b601e1e]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG os_brick.utils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating existing volume attachment record: 72a037ae-5fba-43e7-8c09-caa0406eff8a {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Successfully created port: 7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Successfully updated port: 7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquired lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-changed-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Refreshing instance network info cache due to event network-changed-7b2da675-d0c4-45cb-9e22-23eb981519b0. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] Acquiring lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:15:17 user nova-compute[75233]: DEBUG nova.network.neutron [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Releasing lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Instance network_info: |[{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] Acquired lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG nova.network.neutron [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Refreshing network info cache for port 7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG nova.network.neutron [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updated VIF entry in instance network info cache for port 7b2da675-d0c4-45cb-9e22-23eb981519b0. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG nova.network.neutron [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:15:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9ed4c0d5-3cb1-4964-b02d-817f21089333 req-b3980e51-c857-4e7d-8187-f7f93a9e46ef service nova] Releasing lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:15:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:15:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:15:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:15:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:15:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:15:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:15:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Creating image(s)
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Ensure instance console log exists: /opt/stack/data/nova/instances/6ac15324-7335-4524-a93d-b51bf216d6df/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Start _get_guest_xml network_info=[{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBwRaYED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ac15324-7335-4524-a93d-b51bf216d6df', 'attached_at': '', 'detached_at': '', 'volume_id': '08725345-1042-4a30-bd59-6e1260b3c824', 'serial': '08725345-1042-4a30-bd59-6e1260b3c824'}, 'delete_on_termination': True, 'attachment_id': '72a037ae-5fba-43e7-8c09-caa0406eff8a', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:15:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:15:25 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBwRaYED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:15:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:15:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:15:25 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff5115-8d5f-4435-8b56-2f7f8365dd9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:15:25 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[352c06cd-ab4c-47e1-836d-40df7cb65be0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824] added
Dec 05 14:15:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e887c3e-53c8-402a-b833-a8d670594069]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca1af4-6a69-453b-815e-ecc34c8473a8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBwRaYED {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBwRaYED" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34a5d5-82fd-43ca-bdd9-5148bc25297b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBwRaYED'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37583d-0b1c-46a9-afa6-9b90ee6135c4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[232993e0-ba0d-499e-9302-1b9882e39768]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:15:25 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:15:25 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:15:25 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:15:25 user nova-compute[75233]: 
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5911728-7684-4177-b9f6-c57dda8201db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260]
Dec 05 14:15:25 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260] successful.
Dec 05 14:15:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f767e9de-5da7-4d56-8532-4990c472ce6b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d21b98e-6c6c-4750-8b73-358be7320a31]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:15:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:15:25 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d096a7af-d8c9-4bd4-b526-51db4006cf5f]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:15:25 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBwRaYED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23233366331626163', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233366331626163', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1155068181',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1155068181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1155068181',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcc0qwJOhFSVaFsR7NYss0rSfvERxM5bei/nLgVVnHR2gXkFfMcqgPvFCeaF+0yxAsIOFAuvGM1k4k2qhouquOrCiaJbw67P0PrG4P/8SaPpSfMYss7q+HF+1Ay7ptz8g==',key_name='tempest-keypair-350277736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-9n0h88w6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:15:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=6ac15324-7335-4524-a93d-b51bf216d6df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ac15324-7335-4524-a93d-b51bf216d6df {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:15:26 user nova-compute[75233]:   <uuid>6ac15324-7335-4524-a93d-b51bf216d6df</uuid>
Dec 05 14:15:26 user nova-compute[75233]:   <name>instance-0000002e</name>
Dec 05 14:15:26 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:15:26 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:15:26 user nova-compute[75233]:   <metadata>
Dec 05 14:15:26 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:15:26 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:15:26 user nova-compute[75233]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1155068181</nova:name>
Dec 05 14:15:26 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:15:25</nova:creationTime>
Dec 05 14:15:26 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:15:26 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:15:26 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:15:26 user nova-compute[75233]:       <nova:owner>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:user uuid="bc0980778b5e4b6999590c1f311a1c1d">tempest-TestVolumeBootPattern-1094285123-project-member</nova:user>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:project uuid="c9cfadfed75341e8aa2e5b4f87e962d9">tempest-TestVolumeBootPattern-1094285123</nova:project>
Dec 05 14:15:26 user nova-compute[75233]:       </nova:owner>
Dec 05 14:15:26 user nova-compute[75233]:       <nova:ports>
Dec 05 14:15:26 user nova-compute[75233]:         <nova:port uuid="7b2da675-d0c4-45cb-9e22-23eb981519b0">
Dec 05 14:15:26 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 14:15:26 user nova-compute[75233]:         </nova:port>
Dec 05 14:15:26 user nova-compute[75233]:       </nova:ports>
Dec 05 14:15:26 user nova-compute[75233]:     </nova:instance>
Dec 05 14:15:26 user nova-compute[75233]:   </metadata>
Dec 05 14:15:26 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:15:26 user nova-compute[75233]:     <system>
Dec 05 14:15:26 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:15:26 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:15:26 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:15:26 user nova-compute[75233]:       <entry name="serial">6ac15324-7335-4524-a93d-b51bf216d6df</entry>
Dec 05 14:15:26 user nova-compute[75233]:       <entry name="uuid">6ac15324-7335-4524-a93d-b51bf216d6df</entry>
Dec 05 14:15:26 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:15:26 user nova-compute[75233]:     </system>
Dec 05 14:15:26 user nova-compute[75233]:   </sysinfo>
Dec 05 14:15:26 user nova-compute[75233]:   <os>
Dec 05 14:15:26 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:15:26 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:15:26 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:15:26 user nova-compute[75233]:   </os>
Dec 05 14:15:26 user nova-compute[75233]:   <features>
Dec 05 14:15:26 user nova-compute[75233]:     <acpi/>
Dec 05 14:15:26 user nova-compute[75233]:     <apic/>
Dec 05 14:15:26 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:15:26 user nova-compute[75233]:   </features>
Dec 05 14:15:26 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:15:26 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:15:26 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:15:26 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:15:26 user nova-compute[75233]:   </clock>
Dec 05 14:15:26 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:15:26 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:15:26 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:15:26 user nova-compute[75233]:   </cpu>
Dec 05 14:15:26 user nova-compute[75233]:   <devices>
Dec 05 14:15:26 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:15:26 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:15:26 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 14:15:26 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:15:26 user nova-compute[75233]:       <serial>08725345-1042-4a30-bd59-6e1260b3c824</serial>
Dec 05 14:15:26 user nova-compute[75233]:     </disk>
Dec 05 14:15:26 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:15:26 user nova-compute[75233]:       <mac address="fa:16:3e:35:c9:1c"/>
Dec 05 14:15:26 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:15:26 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:15:26 user nova-compute[75233]:       <target dev="tap7b2da675-d0"/>
Dec 05 14:15:26 user nova-compute[75233]:     </interface>
Dec 05 14:15:26 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:15:26 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/6ac15324-7335-4524-a93d-b51bf216d6df/console.log" append="off"/>
Dec 05 14:15:26 user nova-compute[75233]:     </serial>
Dec 05 14:15:26 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:15:26 user nova-compute[75233]:     <video>
Dec 05 14:15:26 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:15:26 user nova-compute[75233]:     </video>
Dec 05 14:15:26 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:15:26 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:15:26 user nova-compute[75233]:     </rng>
Dec 05 14:15:26 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:15:26 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:15:26 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:15:26 user nova-compute[75233]:     </memballoon>
Dec 05 14:15:26 user nova-compute[75233]:   </devices>
Dec 05 14:15:26 user nova-compute[75233]: </domain>
Dec 05 14:15:26 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1155068181',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1155068181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1155068181',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcc0qwJOhFSVaFsR7NYss0rSfvERxM5bei/nLgVVnHR2gXkFfMcqgPvFCeaF+0yxAsIOFAuvGM1k4k2qhouquOrCiaJbw67P0PrG4P/8SaPpSfMYss7q+HF+1Ay7ptz8g==',key_name='tempest-keypair-350277736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-9n0h88w6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:15:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=6ac15324-7335-4524-a93d-b51bf216d6df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG os_vif [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbd7edb2-67f9-5ba0-bacd-56c9466ac40c', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b2da675-d0, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b2da675-d0, col_values=(('qos', UUID('eef80c3e-f065-459a-92bc-4fa92e05c3be')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b2da675-d0, col_values=(('external_ids', {'iface-id': '7b2da675-d0c4-45cb-9e22-23eb981519b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:c9:1c', 'vm-uuid': '6ac15324-7335-4524-a93d-b51bf216d6df'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:26 user nova-compute[75233]: INFO os_vif [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0')
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:15:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No VIF found with MAC fa:16:3e:35:c9:1c, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:15:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-7af954cf-ca61-467a-99b8-744a8efc9a2f req-8578d374-6d9c-4227-beda-880e659e7964 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7af954cf-ca61-467a-99b8-744a8efc9a2f req-8578d374-6d9c-4227-beda-880e659e7964 service nova] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7af954cf-ca61-467a-99b8-744a8efc9a2f req-8578d374-6d9c-4227-beda-880e659e7964 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7af954cf-ca61-467a-99b8-744a8efc9a2f req-8578d374-6d9c-4227-beda-880e659e7964 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-7af954cf-ca61-467a-99b8-744a8efc9a2f req-8578d374-6d9c-4227-beda-880e659e7964 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] No waiting events found dispatching network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:15:28 user nova-compute[75233]: WARNING nova.compute.manager [req-7af954cf-ca61-467a-99b8-744a8efc9a2f req-8578d374-6d9c-4227-beda-880e659e7964 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received unexpected event network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 for instance with vm_state building and task_state spawning.
Dec 05 14:15:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:15:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:15:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Instance spawned successfully.
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:15:30 user nova-compute[75233]: INFO nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Took 4.90 seconds to spawn the instance on the hypervisor.
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-aaa6a611-0f00-4407-bea2-8a07e551ccee req-41552ce6-349f-41da-be8c-5e3d41ba77f6 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aaa6a611-0f00-4407-bea2-8a07e551ccee req-41552ce6-349f-41da-be8c-5e3d41ba77f6 service nova] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aaa6a611-0f00-4407-bea2-8a07e551ccee req-41552ce6-349f-41da-be8c-5e3d41ba77f6 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-aaa6a611-0f00-4407-bea2-8a07e551ccee req-41552ce6-349f-41da-be8c-5e3d41ba77f6 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-aaa6a611-0f00-4407-bea2-8a07e551ccee req-41552ce6-349f-41da-be8c-5e3d41ba77f6 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] No waiting events found dispatching network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:15:30 user nova-compute[75233]: WARNING nova.compute.manager [req-aaa6a611-0f00-4407-bea2-8a07e551ccee req-41552ce6-349f-41da-be8c-5e3d41ba77f6 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received unexpected event network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 for instance with vm_state building and task_state spawning.
Dec 05 14:15:30 user nova-compute[75233]: INFO nova.compute.manager [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Took 14.40 seconds to build instance.
Dec 05 14:15:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-25bbef76-4be1-41d5-a055-a31cd9add007 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "6ac15324-7335-4524-a93d-b51bf216d6df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.498s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 6ac15324-7335-4524-a93d-b51bf216d6df {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:31 user nova-compute[75233]: INFO nova.compute.manager [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Unshelving
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'pci_requests' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'numa_topology' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:15:32 user nova-compute[75233]: INFO nova.compute.claims [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Claim successful on node user
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:32 user nova-compute[75233]: INFO nova.network.neutron [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating port fe3629a5-3bef-49a7-bddd-7e3d28a70e59 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG nova.compute.manager [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing instance network info cache due to event network-changed-fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:15:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG nova.network.neutron [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:15:33 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Creating image(s)
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'trusted_certs' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG nova.network.neutron [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Refreshing network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG nova.objects.base [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<879b4c1d-9e8c-4fca-bb8f-80c794c2f835> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "f593134cfbda9d83ac81c92235948dde73a0cd78" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "f593134cfbda9d83ac81c92235948dde73a0cd78" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.part --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.part --force-share --output=json" returned: 0 in 0.235s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG nova.virt.images [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] fbb2ffa6-3a84-4063-b31b-cba23d94ba4f was qcow2, converting to raw {{(pid=75233) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG nova.privsep.utils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75233) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.part /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.converted {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG nova.network.neutron [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updated VIF entry in instance network info cache for port fe3629a5-3bef-49a7-bddd-7e3d28a70e59. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG nova.network.neutron [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f868bab8-7d06-4c0a-a99f-1baea1fa049d req-2c73b50d-eda2-43ea-b99f-72f983fbc555 service nova] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.part /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.converted" returned: 0 in 0.373s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:34 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.converted --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "f593134cfbda9d83ac81c92235948dde73a0cd78" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.814s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78 --force-share --output=json" returned: 0 in 0.185s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "f593134cfbda9d83ac81c92235948dde73a0cd78" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "f593134cfbda9d83ac81c92235948dde73a0cd78" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78 --force-share --output=json" returned: 0 in 0.192s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78,backing_fmt=raw /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78,backing_fmt=raw /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk 1073741824" returned: 0 in 0.046s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "f593134cfbda9d83ac81c92235948dde73a0cd78" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78 --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f593134cfbda9d83ac81c92235948dde73a0cd78 --force-share --output=json" returned: 0 in 0.189s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'migration_context' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG nova.objects.base [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<879b4c1d-9e8c-4fca-bb8f-80c794c2f835> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:15:35 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Rebasing disk image.
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.201s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:35 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec -F raw /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:15:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec -F raw /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk" returned: 0 in 2.218s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Ensure instance console log exists: /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Start _get_guest_xml network_info=[{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c09d79748aec686f76912459413820a8',container_format='bare',created_at=2023-12-05T14:13:39Z,direct_url=<?>,disk_format='qcow2',id=fbb2ffa6-3a84-4063-b31b-cba23d94ba4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1361081831-shelved',owner='536eea64226a4234a4603ba5cf20cf1c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T14:13:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:15:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:15:38 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c09d79748aec686f76912459413820a8',container_format='bare',created_at=2023-12-05T14:13:39Z,direct_url=<?>,disk_format='qcow2',id=fbb2ffa6-3a84-4063-b31b-cba23d94ba4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1361081831-shelved',owner='536eea64226a4234a4603ba5cf20cf1c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T14:13:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'vcpu_model' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.objects.base [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<879b4c1d-9e8c-4fca-bb8f-80c794c2f835> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T14:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1361081831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1361081831',id=44,image_ref='fbb2ffa6-3a84-4063-b31b-cba23d94ba4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1452970862',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-ksked0v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member',shelved_at='2023-12-05T14:13:43.183145',shelved_host='user',shelved_image_id='fbb2ffa6-3a84-4063-b31b-cba23d94ba4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=879b4c1d-9e8c-4fca-bb8f-80c794c2f835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.objects.instance [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'pci_devices' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.objects.base [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Object Instance<879b4c1d-9e8c-4fca-bb8f-80c794c2f835> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75233) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:15:38 user nova-compute[75233]:   <uuid>879b4c1d-9e8c-4fca-bb8f-80c794c2f835</uuid>
Dec 05 14:15:38 user nova-compute[75233]:   <name>instance-0000002c</name>
Dec 05 14:15:38 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:15:38 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:15:38 user nova-compute[75233]:   <metadata>
Dec 05 14:15:38 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:15:38 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:15:38 user nova-compute[75233]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1361081831</nova:name>
Dec 05 14:15:38 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:15:38</nova:creationTime>
Dec 05 14:15:38 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:15:38 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:15:38 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:15:38 user nova-compute[75233]:       <nova:owner>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:user uuid="317f3e447b58464eb428e63ac23f80c6">tempest-AttachVolumeShelveTestJSON-1457724058-project-member</nova:user>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:project uuid="536eea64226a4234a4603ba5cf20cf1c">tempest-AttachVolumeShelveTestJSON-1457724058</nova:project>
Dec 05 14:15:38 user nova-compute[75233]:       </nova:owner>
Dec 05 14:15:38 user nova-compute[75233]:       <nova:root type="image" uuid="fbb2ffa6-3a84-4063-b31b-cba23d94ba4f"/>
Dec 05 14:15:38 user nova-compute[75233]:       <nova:ports>
Dec 05 14:15:38 user nova-compute[75233]:         <nova:port uuid="fe3629a5-3bef-49a7-bddd-7e3d28a70e59">
Dec 05 14:15:38 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 14:15:38 user nova-compute[75233]:         </nova:port>
Dec 05 14:15:38 user nova-compute[75233]:       </nova:ports>
Dec 05 14:15:38 user nova-compute[75233]:     </nova:instance>
Dec 05 14:15:38 user nova-compute[75233]:   </metadata>
Dec 05 14:15:38 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:15:38 user nova-compute[75233]:     <system>
Dec 05 14:15:38 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:15:38 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:15:38 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:15:38 user nova-compute[75233]:       <entry name="serial">879b4c1d-9e8c-4fca-bb8f-80c794c2f835</entry>
Dec 05 14:15:38 user nova-compute[75233]:       <entry name="uuid">879b4c1d-9e8c-4fca-bb8f-80c794c2f835</entry>
Dec 05 14:15:38 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:15:38 user nova-compute[75233]:     </system>
Dec 05 14:15:38 user nova-compute[75233]:   </sysinfo>
Dec 05 14:15:38 user nova-compute[75233]:   <os>
Dec 05 14:15:38 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:15:38 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:15:38 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:15:38 user nova-compute[75233]:   </os>
Dec 05 14:15:38 user nova-compute[75233]:   <features>
Dec 05 14:15:38 user nova-compute[75233]:     <acpi/>
Dec 05 14:15:38 user nova-compute[75233]:     <apic/>
Dec 05 14:15:38 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:15:38 user nova-compute[75233]:   </features>
Dec 05 14:15:38 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:15:38 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:15:38 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:15:38 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:15:38 user nova-compute[75233]:   </clock>
Dec 05 14:15:38 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:15:38 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:15:38 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:15:38 user nova-compute[75233]:   </cpu>
Dec 05 14:15:38 user nova-compute[75233]:   <devices>
Dec 05 14:15:38 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:15:38 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:15:38 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk"/>
Dec 05 14:15:38 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:15:38 user nova-compute[75233]:     </disk>
Dec 05 14:15:38 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:15:38 user nova-compute[75233]:       <mac address="fa:16:3e:22:1a:3f"/>
Dec 05 14:15:38 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:15:38 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:15:38 user nova-compute[75233]:       <target dev="tapfe3629a5-3b"/>
Dec 05 14:15:38 user nova-compute[75233]:     </interface>
Dec 05 14:15:38 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:15:38 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/console.log" append="off"/>
Dec 05 14:15:38 user nova-compute[75233]:     </serial>
Dec 05 14:15:38 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:15:38 user nova-compute[75233]:     <video>
Dec 05 14:15:38 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:15:38 user nova-compute[75233]:     </video>
Dec 05 14:15:38 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:15:38 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:15:38 user nova-compute[75233]:     </rng>
Dec 05 14:15:38 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:15:38 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:15:38 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:15:38 user nova-compute[75233]:     </memballoon>
Dec 05 14:15:38 user nova-compute[75233]:   </devices>
Dec 05 14:15:38 user nova-compute[75233]: </domain>
Dec 05 14:15:38 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T14:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1361081831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1361081831',id=44,image_ref='fbb2ffa6-3a84-4063-b31b-cba23d94ba4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1452970862',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-ksked0v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member',shelved_at='2023-12-05T14:13:43.183145',shelved_host='user',shelved_image_id='fbb2ffa6-3a84-4063-b31b-cba23d94ba4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=879b4c1d-9e8c-4fca-bb8f-80c794c2f835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG os_vif [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f164c20b-1dec-5b0f-885e-297c286950d7', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe3629a5-3b, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe3629a5-3b, col_values=(('qos', UUID('7f32807e-4379-4fe5-8351-0e49a90de17c')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe3629a5-3b, col_values=(('external_ids', {'iface-id': 'fe3629a5-3bef-49a7-bddd-7e3d28a70e59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:1a:3f', 'vm-uuid': '879b4c1d-9e8c-4fca-bb8f-80c794c2f835'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:38 user nova-compute[75233]: INFO os_vif [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b')
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:15:38 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] No VIF found with MAC fa:16:3e:22:1a:3f, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:15:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-615a9a33-4d32-48fd-848c-ac9bb16759ec req-8ec54643-9e2a-4e8c-b9e0-7e02dca4fc46 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-615a9a33-4d32-48fd-848c-ac9bb16759ec req-8ec54643-9e2a-4e8c-b9e0-7e02dca4fc46 service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-615a9a33-4d32-48fd-848c-ac9bb16759ec req-8ec54643-9e2a-4e8c-b9e0-7e02dca4fc46 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-615a9a33-4d32-48fd-848c-ac9bb16759ec req-8ec54643-9e2a-4e8c-b9e0-7e02dca4fc46 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-615a9a33-4d32-48fd-848c-ac9bb16759ec req-8ec54643-9e2a-4e8c-b9e0-7e02dca4fc46 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:15:40 user nova-compute[75233]: WARNING nova.compute.manager [req-615a9a33-4d32-48fd-848c-ac9bb16759ec req-8ec54643-9e2a-4e8c-b9e0-7e02dca4fc46 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 14:15:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-775a12af-ade4-462b-8d40-da3d25ae5d67 req-1b9bbe6a-7e76-47aa-b9d1-79f87da6ebf4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-775a12af-ade4-462b-8d40-da3d25ae5d67 req-1b9bbe6a-7e76-47aa-b9d1-79f87da6ebf4 service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-775a12af-ade4-462b-8d40-da3d25ae5d67 req-1b9bbe6a-7e76-47aa-b9d1-79f87da6ebf4 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-775a12af-ade4-462b-8d40-da3d25ae5d67 req-1b9bbe6a-7e76-47aa-b9d1-79f87da6ebf4 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-775a12af-ade4-462b-8d40-da3d25ae5d67 req-1b9bbe6a-7e76-47aa-b9d1-79f87da6ebf4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:15:42 user nova-compute[75233]: WARNING nova.compute.manager [req-775a12af-ade4-462b-8d40-da3d25ae5d67 req-1b9bbe6a-7e76-47aa-b9d1-79f87da6ebf4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 14:15:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:15:42 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance spawned successfully.
Dec 05 14:15:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:15:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-06a3c2d9-44db-447e-891b-8c65a315312b tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.850s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 6ac15324-7335-4524-a93d-b51bf216d6df {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "6ac15324-7335-4524-a93d-b51bf216d6df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "6ac15324-7335-4524-a93d-b51bf216d6df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:15:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:09 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:16:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:16:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:16:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=24.869163513183594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 6ac15324-7335-4524-a93d-b51bf216d6df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:16:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:16:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:16:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:16:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:16:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:16:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:16:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [{"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:16:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-879b4c1d-9e8c-4fca-bb8f-80c794c2f835" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:16:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:16:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:16:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:16:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:16:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:16:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:16:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-changed-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Refreshing instance network info cache due to event network-changed-7b2da675-d0c4-45cb-9e22-23eb981519b0. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] Acquiring lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] Acquired lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Refreshing network info cache for port 7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updated VIF entry in instance network info cache for port 7b2da675-d0c4-45cb-9e22-23eb981519b0. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG nova.network.neutron [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:17:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c233b69d-4454-4c66-a79d-cea38dafb743 req-58f6726e-140c-4bad-a7e0-f761331c4b37 service nova] Releasing lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:17:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:17:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:17:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:17:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:10 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:17:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:17:14 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=24.867889404296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 6ac15324-7335-4524-a93d-b51bf216d6df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 19b791a1-ad4b-4965-97ac-7a5012f4a9b7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.038s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:17:14 user nova-compute[75233]: INFO nova.compute.claims [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Claim successful on node user
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:17:14 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:17:14 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:17:15 user nova-compute[75233]: INFO nova.virt.block_device [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Booting with volume snapshot 603b6bb7-2e37-42d8-8d05-ec41e3639574 at /dev/vda
Dec 05 14:17:15 user nova-compute[75233]: DEBUG nova.policy [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0980778b5e4b6999590c1f311a1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cfadfed75341e8aa2e5b4f87e962d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:17:15 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Successfully created port: 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Successfully updated port: 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquired lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-changed-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.compute.manager [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Refreshing instance network info cache due to event network-changed-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] Acquiring lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updating instance_info_cache with network_info: [{"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Releasing lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Instance network_info: |[{"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] Acquired lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Refreshing network info cache for port 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updated VIF entry in instance network info cache for port 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG nova.network.neutron [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updating instance_info_cache with network_info: [{"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:17:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9930343f-6410-49c9-8180-ce92f6d9d377 req-1e5a39dc-524e-4048-a026-4ede6f6c1060 service nova] Releasing lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:17:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG os_brick.utils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e923f0e-0490-401f-9b32-66872bc208d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a86190-e5de-41e2-ad8e-1866a0adc3a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[339de7b5-48e4-46b8-93b7-06d017d1c024]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b67d9a-9507-46f4-b1f5-bf77340e584c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:17:20 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:17:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3d4011-9215-4335-96e8-b9c54dd0500b]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG os_brick.utils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:17:20 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updating existing volume attachment record: ed40cc7f-4bd8-41a6-8bf9-093b66a18959 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:17:21 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:22 user nova-compute[75233]: INFO nova.compute.manager [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Terminating instance
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-ec5f46a4-0743-4b51-a07e-6345a45c36b1 req-ea21a40c-7936-4e57-85f7-bb312fc87043 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ec5f46a4-0743-4b51-a07e-6345a45c36b1 req-ea21a40c-7936-4e57-85f7-bb312fc87043 service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ec5f46a4-0743-4b51-a07e-6345a45c36b1 req-ea21a40c-7936-4e57-85f7-bb312fc87043 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ec5f46a4-0743-4b51-a07e-6345a45c36b1 req-ea21a40c-7936-4e57-85f7-bb312fc87043 service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-ec5f46a4-0743-4b51-a07e-6345a45c36b1 req-ea21a40c-7936-4e57-85f7-bb312fc87043 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.compute.manager [req-ec5f46a4-0743-4b51-a07e-6345a45c36b1 req-ea21a40c-7936-4e57-85f7-bb312fc87043 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Instance destroyed successfully.
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.objects.instance [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lazy-loading 'resources' on Instance uuid 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T14:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1361081831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1361081831',id=44,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4YxPAtgpuU5p8mW5seeGaJTwkOB9So1CqdhkKFE9F5k0CwHJjdsNrhI2Wzp4VDS5mlpUgMw7OrRPVLdDBkK1CW8BUV5azh8pEYc+wnWIsCgmCtuq/eh4gQqaOQ5GKcDw==',key_name='tempest-keypair-1452970862',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='536eea64226a4234a4603ba5cf20cf1c',ramdisk_id='',reservation_id='r-ksked0v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1457724058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1457724058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='317f3e447b58464eb428e63ac23f80c6',uuid=879b4c1d-9e8c-4fca-bb8f-80c794c2f835,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converting VIF {"id": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "address": "fa:16:3e:22:1a:3f", "network": {"id": "0177b1e2-0971-46b2-857b-c7591355575f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-87074116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "536eea64226a4234a4603ba5cf20cf1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3629a5-3b", "ovs_interfaceid": "fe3629a5-3bef-49a7-bddd-7e3d28a70e59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG os_vif [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe3629a5-3b, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f32807e-4379-4fe5-8351-0e49a90de17c) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:22 user nova-compute[75233]: INFO os_vif [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:1a:3f,bridge_name='br-int',has_traffic_filtering=True,id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59,network=Network(0177b1e2-0971-46b2-857b-c7591355575f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3629a5-3b')
Dec 05 14:17:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Deleting instance files /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835_del
Dec 05 14:17:22 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Deletion of /opt/stack/data/nova/instances/879b4c1d-9e8c-4fca-bb8f-80c794c2f835_del complete
Dec 05 14:17:22 user nova-compute[75233]: INFO nova.compute.manager [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 05 14:17:22 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:17:22 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-1b3900b7-478f-4ee7-9521-a87d9e688b43 req-1f126590-d1c4-44ed-8ea7-5097e585f6b4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-deleted-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:23 user nova-compute[75233]: INFO nova.compute.manager [req-1b3900b7-478f-4ee7-9521-a87d9e688b43 req-1f126590-d1c4-44ed-8ea7-5097e585f6b4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Neutron deleted interface fe3629a5-3bef-49a7-bddd-7e3d28a70e59; detaching it from the instance and deleting it from the info cache
Dec 05 14:17:23 user nova-compute[75233]: DEBUG nova.network.neutron [req-1b3900b7-478f-4ee7-9521-a87d9e688b43 req-1f126590-d1c4-44ed-8ea7-5097e585f6b4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:17:23 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Took 0.76 seconds to deallocate network for instance.
Dec 05 14:17:23 user nova-compute[75233]: DEBUG nova.compute.manager [req-1b3900b7-478f-4ee7-9521-a87d9e688b43 req-1f126590-d1c4-44ed-8ea7-5097e585f6b4 service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Detach interface failed, port_id=fe3629a5-3bef-49a7-bddd-7e3d28a70e59, reason: Instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:17:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:23 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Deleted allocations for instance 879b4c1d-9e8c-4fca-bb8f-80c794c2f835
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-dee78567-9312-4707-8b00-73d74b80da6c tempest-AttachVolumeShelveTestJSON-1457724058 tempest-AttachVolumeShelveTestJSON-1457724058-project-member] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:24 user nova-compute[75233]: WARNING nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state deleted and task_state None.
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:24 user nova-compute[75233]: WARNING nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state deleted and task_state None.
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:24 user nova-compute[75233]: WARNING nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state deleted and task_state None.
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:24 user nova-compute[75233]: WARNING nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-unplugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state deleted and task_state None.
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Acquiring lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] Lock "879b4c1d-9e8c-4fca-bb8f-80c794c2f835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:24 user nova-compute[75233]: DEBUG nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] No waiting events found dispatching network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:24 user nova-compute[75233]: WARNING nova.compute.manager [req-6f14d1bc-f1d8-4ac3-a71f-9b8afd43d39d req-045a0e29-7da7-4471-88a2-96be9a95792b service nova] [instance: 879b4c1d-9e8c-4fca-bb8f-80c794c2f835] Received unexpected event network-vif-plugged-fe3629a5-3bef-49a7-bddd-7e3d28a70e59 for instance with vm_state deleted and task_state None.
Dec 05 14:17:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:17:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Creating image(s)
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Ensure instance console log exists: /opt/stack/data/nova/instances/19b791a1-ad4b-4965-97ac-7a5012f4a9b7/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Start _get_guest_xml network_info=[{"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-05T14:17:08Z,direct_url=<?>,disk_format='qcow2',id=cd86fb3e-d5cc-4640-b8f0-87bb74a9be93,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1876590804',owner='c9cfadfed75341e8aa2e5b4f87e962d9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-05T14:17:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUsTxmCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19b791a1-ad4b-4965-97ac-7a5012f4a9b7', 'attached_at': '', 'detached_at': '', 'volume_id': '0c7bca1c-1712-4005-a8c6-ae74cf795c67', 'serial': '0c7bca1c-1712-4005-a8c6-ae74cf795c67'}, 'delete_on_termination': True, 'attachment_id': 'ed40cc7f-4bd8-41a6-8bf9-093b66a18959', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:17:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:17:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-05T14:17:08Z,direct_url=<?>,disk_format='qcow2',id=cd86fb3e-d5cc-4640-b8f0-87bb74a9be93,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1876590804',owner='c9cfadfed75341e8aa2e5b4f87e962d9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-05T14:17:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUsTxmCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:17:30 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:17:30 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:17:30 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c98dd6-c264-434c-a82a-94e57d40f427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:17:30 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2491f2-777c-47c5-8d79-b83c1d80971c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67] added
Dec 05 14:17:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8376d-9c90-476d-9c3f-80f0efc76dd9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb53f5-4a41-4047-a48a-919602dd2dcf]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MUsTxmCJ {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MUsTxmCJ" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cbe030-5828-4aaf-9902-1b887b586ab9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MUsTxmCJ'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[599ed97f-416b-4d0d-9efc-63ae638bcd1f]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5cdada-df89-40ea-9290-33e5dd25665a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:17:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:17:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3b9b9-adc4-40d1-a758-b789b65975f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260]
Dec 05 14:17:30 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260] successful.
Dec 05 14:17:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835a968-db8e-4f19-a815-e44155154df8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1df4c1-4237-4880-b803-0d89301e09f5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:17:30 user nova-compute[75233]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 (non-flash)
Dec 05 14:17:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:17:30 user nova-compute[75233]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 (non-flash)
Dec 05 14:17:30 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[180a0b57-1cd1-4b25-a738-571fdff5cd56]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:17:30 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUsTxmCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23166353163613237', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166353163613237', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-110656998',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-110656998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-110656998',id=47,image_ref='cd86fb3e-d5cc-4640-b8f0-87bb74a9be93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArNIUugMmr+OZPJMMgIjiRKIzt71/YN4SVEH5Wy2LyS1iwz5eAsxc8/d6GaHiY5B1j0AYHm/hSOdLQDy4P/5IVaf0oXvuegC8uaCZxK9z58roJYyWz3HMSpzuPsB2+X0w==',key_name='tempest-keypair-345658546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-r6ybt6sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1094285123',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=19b791a1-ad4b-4965-97ac-7a5012f4a9b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.objects.instance [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'pci_devices' on Instance uuid 19b791a1-ad4b-4965-97ac-7a5012f4a9b7 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:17:31 user nova-compute[75233]:   <uuid>19b791a1-ad4b-4965-97ac-7a5012f4a9b7</uuid>
Dec 05 14:17:31 user nova-compute[75233]:   <name>instance-0000002f</name>
Dec 05 14:17:31 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:17:31 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:17:31 user nova-compute[75233]:   <metadata>
Dec 05 14:17:31 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:17:31 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:17:31 user nova-compute[75233]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-110656998</nova:name>
Dec 05 14:17:31 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:17:30</nova:creationTime>
Dec 05 14:17:31 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:17:31 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:17:31 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:17:31 user nova-compute[75233]:       <nova:owner>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:user uuid="bc0980778b5e4b6999590c1f311a1c1d">tempest-TestVolumeBootPattern-1094285123-project-member</nova:user>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:project uuid="c9cfadfed75341e8aa2e5b4f87e962d9">tempest-TestVolumeBootPattern-1094285123</nova:project>
Dec 05 14:17:31 user nova-compute[75233]:       </nova:owner>
Dec 05 14:17:31 user nova-compute[75233]:       <nova:root type="image" uuid="cd86fb3e-d5cc-4640-b8f0-87bb74a9be93"/>
Dec 05 14:17:31 user nova-compute[75233]:       <nova:ports>
Dec 05 14:17:31 user nova-compute[75233]:         <nova:port uuid="942fb66a-896d-4a2e-aa45-b1fd0b5d99dc">
Dec 05 14:17:31 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 14:17:31 user nova-compute[75233]:         </nova:port>
Dec 05 14:17:31 user nova-compute[75233]:       </nova:ports>
Dec 05 14:17:31 user nova-compute[75233]:     </nova:instance>
Dec 05 14:17:31 user nova-compute[75233]:   </metadata>
Dec 05 14:17:31 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:17:31 user nova-compute[75233]:     <system>
Dec 05 14:17:31 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:17:31 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:17:31 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:17:31 user nova-compute[75233]:       <entry name="serial">19b791a1-ad4b-4965-97ac-7a5012f4a9b7</entry>
Dec 05 14:17:31 user nova-compute[75233]:       <entry name="uuid">19b791a1-ad4b-4965-97ac-7a5012f4a9b7</entry>
Dec 05 14:17:31 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:17:31 user nova-compute[75233]:     </system>
Dec 05 14:17:31 user nova-compute[75233]:   </sysinfo>
Dec 05 14:17:31 user nova-compute[75233]:   <os>
Dec 05 14:17:31 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:17:31 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:17:31 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:17:31 user nova-compute[75233]:   </os>
Dec 05 14:17:31 user nova-compute[75233]:   <features>
Dec 05 14:17:31 user nova-compute[75233]:     <acpi/>
Dec 05 14:17:31 user nova-compute[75233]:     <apic/>
Dec 05 14:17:31 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:17:31 user nova-compute[75233]:   </features>
Dec 05 14:17:31 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:17:31 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:17:31 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:17:31 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:17:31 user nova-compute[75233]:   </clock>
Dec 05 14:17:31 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:17:31 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:17:31 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:17:31 user nova-compute[75233]:   </cpu>
Dec 05 14:17:31 user nova-compute[75233]:   <devices>
Dec 05 14:17:31 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:17:31 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:17:31 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 14:17:31 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:17:31 user nova-compute[75233]:       <serial>0c7bca1c-1712-4005-a8c6-ae74cf795c67</serial>
Dec 05 14:17:31 user nova-compute[75233]:     </disk>
Dec 05 14:17:31 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:17:31 user nova-compute[75233]:       <mac address="fa:16:3e:be:a9:1b"/>
Dec 05 14:17:31 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:17:31 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:17:31 user nova-compute[75233]:       <target dev="tap942fb66a-89"/>
Dec 05 14:17:31 user nova-compute[75233]:     </interface>
Dec 05 14:17:31 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:17:31 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/19b791a1-ad4b-4965-97ac-7a5012f4a9b7/console.log" append="off"/>
Dec 05 14:17:31 user nova-compute[75233]:     </serial>
Dec 05 14:17:31 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:17:31 user nova-compute[75233]:     <video>
Dec 05 14:17:31 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:17:31 user nova-compute[75233]:     </video>
Dec 05 14:17:31 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:17:31 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:17:31 user nova-compute[75233]:     </rng>
Dec 05 14:17:31 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:17:31 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:17:31 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:17:31 user nova-compute[75233]:     </memballoon>
Dec 05 14:17:31 user nova-compute[75233]:   </devices>
Dec 05 14:17:31 user nova-compute[75233]: </domain>
Dec 05 14:17:31 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-110656998',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-110656998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-110656998',id=47,image_ref='cd86fb3e-d5cc-4640-b8f0-87bb74a9be93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArNIUugMmr+OZPJMMgIjiRKIzt71/YN4SVEH5Wy2LyS1iwz5eAsxc8/d6GaHiY5B1j0AYHm/hSOdLQDy4P/5IVaf0oXvuegC8uaCZxK9z58roJYyWz3HMSpzuPsB2+X0w==',key_name='tempest-keypair-345658546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-r6ybt6sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1094285123',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=19b791a1-ad4b-4965-97ac-7a5012f4a9b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG os_vif [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '912d8a76-7d98-593e-a845-3118174bd088', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap942fb66a-89, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap942fb66a-89, col_values=(('qos', UUID('c7950168-16bd-4f44-a776-22a19b206c21')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap942fb66a-89, col_values=(('external_ids', {'iface-id': '942fb66a-896d-4a2e-aa45-b1fd0b5d99dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:a9:1b', 'vm-uuid': '19b791a1-ad4b-4965-97ac-7a5012f4a9b7'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:31 user nova-compute[75233]: INFO os_vif [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89')
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:17:31 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No VIF found with MAC fa:16:3e:be:a9:1b, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-1e997241-7a51-4b65-8e7e-c1b240366002 req-83d33339-5af8-439d-b7c7-4d89b9d62b99 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e997241-7a51-4b65-8e7e-c1b240366002 req-83d33339-5af8-439d-b7c7-4d89b9d62b99 service nova] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e997241-7a51-4b65-8e7e-c1b240366002 req-83d33339-5af8-439d-b7c7-4d89b9d62b99 service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-1e997241-7a51-4b65-8e7e-c1b240366002 req-83d33339-5af8-439d-b7c7-4d89b9d62b99 service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG nova.compute.manager [req-1e997241-7a51-4b65-8e7e-c1b240366002 req-83d33339-5af8-439d-b7c7-4d89b9d62b99 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] No waiting events found dispatching network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:33 user nova-compute[75233]: WARNING nova.compute.manager [req-1e997241-7a51-4b65-8e7e-c1b240366002 req-83d33339-5af8-439d-b7c7-4d89b9d62b99 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received unexpected event network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc for instance with vm_state building and task_state spawning.
Dec 05 14:17:33 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:17:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:17:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:17:34 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Instance spawned successfully.
Dec 05 14:17:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:17:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:17:34 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:17:35 user nova-compute[75233]: INFO nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Took 4.84 seconds to spawn the instance on the hypervisor.
Dec 05 14:17:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:17:35 user nova-compute[75233]: INFO nova.compute.manager [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Took 20.52 seconds to build instance.
Dec 05 14:17:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-b41948a7-9263-49e1-8d25-7564da5654d4 req-97405d99-f4dc-436c-8c11-ae5591196645 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:17:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b41948a7-9263-49e1-8d25-7564da5654d4 req-97405d99-f4dc-436c-8c11-ae5591196645 service nova] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:17:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b41948a7-9263-49e1-8d25-7564da5654d4 req-97405d99-f4dc-436c-8c11-ae5591196645 service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:17:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b41948a7-9263-49e1-8d25-7564da5654d4 req-97405d99-f4dc-436c-8c11-ae5591196645 service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:35 user nova-compute[75233]: DEBUG nova.compute.manager [req-b41948a7-9263-49e1-8d25-7564da5654d4 req-97405d99-f4dc-436c-8c11-ae5591196645 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] No waiting events found dispatching network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:17:35 user nova-compute[75233]: WARNING nova.compute.manager [req-b41948a7-9263-49e1-8d25-7564da5654d4 req-97405d99-f4dc-436c-8c11-ae5591196645 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received unexpected event network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc for instance with vm_state active and task_state None.
Dec 05 14:17:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-cf500b6a-c52f-4e12-b5dc-0f88a8e4dd29 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.619s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:17:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:17:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:17:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:18:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:18:15 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:18:15 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.893829345703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 6ac15324-7335-4524-a93d-b51bf216d6df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 19b791a1-ad4b-4965-97ac-7a5012f4a9b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:18:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:18:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:18:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:18:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:18:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 6ac15324-7335-4524-a93d-b51bf216d6df {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:18:33 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [{"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:18:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-6ac15324-7335-4524-a93d-b51bf216d6df" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:18:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:18:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:18:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:18:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:18:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:18:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:18:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-changed-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Refreshing instance network info cache due to event network-changed-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] Acquiring lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] Acquired lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Refreshing network info cache for port 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updated VIF entry in instance network info cache for port 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updating instance_info_cache with network_info: [{"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c323bcc6-7142-4804-b4a4-12f007126978 req-e8c857d9-8d9d-4f72-99f7-f67e77f8506d service nova] Releasing lock "refresh_cache-19b791a1-ad4b-4965-97ac-7a5012f4a9b7" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:05 user nova-compute[75233]: INFO nova.compute.manager [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Terminating instance
Dec 05 14:19:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Instance destroyed successfully.
Dec 05 14:19:06 user nova-compute[75233]: DEBUG nova.objects.instance [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'resources' on Instance uuid 19b791a1-ad4b-4965-97ac-7a5012f4a9b7 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-110656998',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-110656998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-110656998',id=47,image_ref='cd86fb3e-d5cc-4640-b8f0-87bb74a9be93',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArNIUugMmr+OZPJMMgIjiRKIzt71/YN4SVEH5Wy2LyS1iwz5eAsxc8/d6GaHiY5B1j0AYHm/hSOdLQDy4P/5IVaf0oXvuegC8uaCZxK9z58roJYyWz3HMSpzuPsB2+X0w==',key_name='tempest-keypair-345658546',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:17:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-r6ybt6sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1094285123',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=19b791a1-ad4b-4965-97ac-7a5012f4a9b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "address": "fa:16:3e:be:a9:1b", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fb66a-89", "ovs_interfaceid": "942fb66a-896d-4a2e-aa45-b1fd0b5d99dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_vif [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap942fb66a-89, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7950168-16bd-4f44-a776-22a19b206c21) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:06 user nova-compute[75233]: INFO os_vif [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:a9:1b,bridge_name='br-int',has_traffic_filtering=True,id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fb66a-89')
Dec 05 14:19:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MUsTxmCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:19:06 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595bc30-d2bc-4007-a322-6f4e4b292954]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:19:06 user nova-compute[75233]: No targets found.
Dec 05 14:19:06 user nova-compute[75233]: iSNS:
Dec 05 14:19:06 user nova-compute[75233]: No targets found.
Dec 05 14:19:06 user nova-compute[75233]: STATIC:
Dec 05 14:19:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824
Dec 05 14:19:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:19:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:19:06 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67
Dec 05 14:19:06 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:19:06 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:19:06 user nova-compute[75233]: FIRMWARE:
Dec 05 14:19:06 user nova-compute[75233]: No targets found.
Dec 05 14:19:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:19:06 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:19:06 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5085cb-91cc-47d2-a174-064b1972a561]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[762913e7-1588-451b-8c8b-36fdf40ab6b1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:19:06 user nova-compute[75233]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 (non-flash)
Dec 05 14:19:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:19:06 user nova-compute[75233]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 (non-flash)
Dec 05 14:19:06 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f585e5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786b540-1ed1-451d-8d27-5da15dd2bbeb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4493f8-55d5-47fd-a464-2ff916d60323]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf51a4a3-947a-4e07-8aed-9f855f3acb8c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:19:06 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4471d2c-b991-4fe8-8e58-092730092ae1]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[766aca24-a352-4bb8-b547-fa3357f9af62]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[42768cca-6126-4a6f-a1b3-ebe31a240842]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260]
Dec 05 14:19:07 user nova-compute[75233]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67, portal: 172.16.0.220,3260] successful.
Dec 05 14:19:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7bca1c-1712-4005-a8c6-ae74cf795c67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9852280a-1a43-4086-af8b-c6534c7fd9e9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== disconnect_volume: return (306ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:19:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Deleting instance files /opt/stack/data/nova/instances/19b791a1-ad4b-4965-97ac-7a5012f4a9b7_del
Dec 05 14:19:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Deletion of /opt/stack/data/nova/instances/19b791a1-ad4b-4965-97ac-7a5012f4a9b7_del complete
Dec 05 14:19:07 user nova-compute[75233]: INFO nova.compute.manager [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Took 1.41 seconds to destroy the instance on the hypervisor.
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:19:07 user nova-compute[75233]: INFO nova.compute.claims [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Claim successful on node user
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-55521237-39eb-4e62-88da-daad5fbee14e req-4a85fdef-9766-4f50-9072-684f5935c58e service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-vif-unplugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55521237-39eb-4e62-88da-daad5fbee14e req-4a85fdef-9766-4f50-9072-684f5935c58e service nova] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55521237-39eb-4e62-88da-daad5fbee14e req-4a85fdef-9766-4f50-9072-684f5935c58e service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-55521237-39eb-4e62-88da-daad5fbee14e req-4a85fdef-9766-4f50-9072-684f5935c58e service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-55521237-39eb-4e62-88da-daad5fbee14e req-4a85fdef-9766-4f50-9072-684f5935c58e service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] No waiting events found dispatching network-vif-unplugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [req-55521237-39eb-4e62-88da-daad5fbee14e req-4a85fdef-9766-4f50-9072-684f5935c58e service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-vif-unplugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.network.neutron [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:19:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:19:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Creating image(s)
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "/opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "/opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.041s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.policy [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c253e9d5cc5a477fbf0c935dc857dfc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf69f7bac3fb4999b6d69e178e2f679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:19:08 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Took 0.71 seconds to deallocate network for instance.
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-acffd870-189f-4206-972a-49ce402569ea req-c7d0d4e2-96a4-4df9-b34e-60818b8fac8f service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-vif-deleted-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:08 user nova-compute[75233]: INFO nova.compute.manager [req-acffd870-189f-4206-972a-49ce402569ea req-c7d0d4e2-96a4-4df9-b34e-60818b8fac8f service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Neutron deleted interface 942fb66a-896d-4a2e-aa45-b1fd0b5d99dc; detaching it from the instance and deleting it from the info cache
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.network.neutron [req-acffd870-189f-4206-972a-49ce402569ea req-c7d0d4e2-96a4-4df9-b34e-60818b8fac8f service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.compute.manager [req-acffd870-189f-4206-972a-49ce402569ea req-c7d0d4e2-96a4-4df9-b34e-60818b8fac8f service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Detach interface failed, port_id=942fb66a-896d-4a2e-aa45-b1fd0b5d99dc, reason: Instance 19b791a1-ad4b-4965-97ac-7a5012f4a9b7 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk 1073741824" returned: 0 in 0.054s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.network.neutron [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Successfully created port: 1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.202s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Cannot resize image /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Ensure instance console log exists: /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:08 user nova-compute[75233]: INFO nova.compute.manager [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Took 0.84 seconds to detach 1 volumes for instance.
Dec 05 14:19:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Deleting volume: 0c7bca1c-1712-4005-a8c6-ae74cf795c67 {{(pid=75233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Successfully updated port: 1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquired lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:19:09 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Deleted allocations for instance 19b791a1-ad4b-4965-97ac-7a5012f4a9b7
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-changed-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Refreshing instance network info cache due to event network-changed-1003ce07-aa1d-469b-8588-4317833660b0. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] Acquiring lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-2a3e0217-0693-46f8-b101-6194ad854de7 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.418s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.neutron [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Updating instance_info_cache with network_info: [{"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Releasing lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Instance network_info: |[{"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] Acquired lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.neutron [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Refreshing network info cache for port 1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Start _get_guest_xml network_info=[{"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:19:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:19:09 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-187374086',display_name='tempest-VolumesActionsTest-instance-187374086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-187374086',id=48,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf69f7bac3fb4999b6d69e178e2f679d',ramdisk_id='',reservation_id='r-y42zrt6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-722927489',owner_user_name='tempest-VolumesActionsTest-722927489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:19:08Z,user_data=None,user_id='c253e9d5cc5a477fbf0c935dc857dfc3',uuid=dbd9a352-15f8-413a-9c75-15da44c7bcbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converting VIF {"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.objects.instance [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lazy-loading 'pci_devices' on Instance uuid dbd9a352-15f8-413a-9c75-15da44c7bcbe {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:19:09 user nova-compute[75233]:   <uuid>dbd9a352-15f8-413a-9c75-15da44c7bcbe</uuid>
Dec 05 14:19:09 user nova-compute[75233]:   <name>instance-00000030</name>
Dec 05 14:19:09 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:19:09 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:19:09 user nova-compute[75233]:   <metadata>
Dec 05 14:19:09 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:19:09 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:19:09 user nova-compute[75233]:       <nova:name>tempest-VolumesActionsTest-instance-187374086</nova:name>
Dec 05 14:19:09 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:19:09</nova:creationTime>
Dec 05 14:19:09 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:19:09 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:19:09 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:19:09 user nova-compute[75233]:       <nova:owner>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:user uuid="c253e9d5cc5a477fbf0c935dc857dfc3">tempest-VolumesActionsTest-722927489-project-member</nova:user>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:project uuid="cf69f7bac3fb4999b6d69e178e2f679d">tempest-VolumesActionsTest-722927489</nova:project>
Dec 05 14:19:09 user nova-compute[75233]:       </nova:owner>
Dec 05 14:19:09 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:19:09 user nova-compute[75233]:       <nova:ports>
Dec 05 14:19:09 user nova-compute[75233]:         <nova:port uuid="1003ce07-aa1d-469b-8588-4317833660b0">
Dec 05 14:19:09 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 14:19:09 user nova-compute[75233]:         </nova:port>
Dec 05 14:19:09 user nova-compute[75233]:       </nova:ports>
Dec 05 14:19:09 user nova-compute[75233]:     </nova:instance>
Dec 05 14:19:09 user nova-compute[75233]:   </metadata>
Dec 05 14:19:09 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:19:09 user nova-compute[75233]:     <system>
Dec 05 14:19:09 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:19:09 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:19:09 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:19:09 user nova-compute[75233]:       <entry name="serial">dbd9a352-15f8-413a-9c75-15da44c7bcbe</entry>
Dec 05 14:19:09 user nova-compute[75233]:       <entry name="uuid">dbd9a352-15f8-413a-9c75-15da44c7bcbe</entry>
Dec 05 14:19:09 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:19:09 user nova-compute[75233]:     </system>
Dec 05 14:19:09 user nova-compute[75233]:   </sysinfo>
Dec 05 14:19:09 user nova-compute[75233]:   <os>
Dec 05 14:19:09 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:19:09 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:19:09 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:19:09 user nova-compute[75233]:   </os>
Dec 05 14:19:09 user nova-compute[75233]:   <features>
Dec 05 14:19:09 user nova-compute[75233]:     <acpi/>
Dec 05 14:19:09 user nova-compute[75233]:     <apic/>
Dec 05 14:19:09 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:19:09 user nova-compute[75233]:   </features>
Dec 05 14:19:09 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:19:09 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:19:09 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:19:09 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:19:09 user nova-compute[75233]:   </clock>
Dec 05 14:19:09 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:19:09 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:19:09 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:19:09 user nova-compute[75233]:   </cpu>
Dec 05 14:19:09 user nova-compute[75233]:   <devices>
Dec 05 14:19:09 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:19:09 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:19:09 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk"/>
Dec 05 14:19:09 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:19:09 user nova-compute[75233]:     </disk>
Dec 05 14:19:09 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:19:09 user nova-compute[75233]:       <mac address="fa:16:3e:bf:09:6a"/>
Dec 05 14:19:09 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:19:09 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:19:09 user nova-compute[75233]:       <target dev="tap1003ce07-aa"/>
Dec 05 14:19:09 user nova-compute[75233]:     </interface>
Dec 05 14:19:09 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:19:09 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/console.log" append="off"/>
Dec 05 14:19:09 user nova-compute[75233]:     </serial>
Dec 05 14:19:09 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:19:09 user nova-compute[75233]:     <video>
Dec 05 14:19:09 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:19:09 user nova-compute[75233]:     </video>
Dec 05 14:19:09 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:19:09 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:19:09 user nova-compute[75233]:     </rng>
Dec 05 14:19:09 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:19:09 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:19:09 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:19:09 user nova-compute[75233]:     </memballoon>
Dec 05 14:19:09 user nova-compute[75233]:   </devices>
Dec 05 14:19:09 user nova-compute[75233]: </domain>
Dec 05 14:19:09 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-187374086',display_name='tempest-VolumesActionsTest-instance-187374086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-187374086',id=48,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf69f7bac3fb4999b6d69e178e2f679d',ramdisk_id='',reservation_id='r-y42zrt6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-722927489',owner_user_name='tempest-VolumesActionsTest-722927489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:19:08Z,user_data=None,user_id='c253e9d5cc5a477fbf0c935dc857dfc3',uuid=dbd9a352-15f8-413a-9c75-15da44c7bcbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converting VIF {"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG os_vif [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9305d522-2ad4-5f20-84b8-4a956949648b', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1003ce07-aa, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1003ce07-aa, col_values=(('qos', UUID('7dd0e16c-171d-4fb2-93e1-7e2a910a37fd')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1003ce07-aa, col_values=(('external_ids', {'iface-id': '1003ce07-aa1d-469b-8588-4317833660b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:09:6a', 'vm-uuid': 'dbd9a352-15f8-413a-9c75-15da44c7bcbe'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:09 user nova-compute[75233]: INFO os_vif [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa')
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-ed4750a9-80de-4560-af74-4c0776a9f578 req-d7027a29-1e02-4f1f-866a-8ff3d15297a4 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received event network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ed4750a9-80de-4560-af74-4c0776a9f578 req-d7027a29-1e02-4f1f-866a-8ff3d15297a4 service nova] Acquiring lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ed4750a9-80de-4560-af74-4c0776a9f578 req-d7027a29-1e02-4f1f-866a-8ff3d15297a4 service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ed4750a9-80de-4560-af74-4c0776a9f578 req-d7027a29-1e02-4f1f-866a-8ff3d15297a4 service nova] Lock "19b791a1-ad4b-4965-97ac-7a5012f4a9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.compute.manager [req-ed4750a9-80de-4560-af74-4c0776a9f578 req-d7027a29-1e02-4f1f-866a-8ff3d15297a4 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] No waiting events found dispatching network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:19:09 user nova-compute[75233]: WARNING nova.compute.manager [req-ed4750a9-80de-4560-af74-4c0776a9f578 req-d7027a29-1e02-4f1f-866a-8ff3d15297a4 service nova] [instance: 19b791a1-ad4b-4965-97ac-7a5012f4a9b7] Received unexpected event network-vif-plugged-942fb66a-896d-4a2e-aa45-b1fd0b5d99dc for instance with vm_state deleted and task_state None.
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:19:09 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] No VIF found with MAC fa:16:3e:bf:09:6a, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:19:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Updated VIF entry in instance network info cache for port 1003ce07-aa1d-469b-8588-4317833660b0. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:19:10 user nova-compute[75233]: DEBUG nova.network.neutron [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Updating instance_info_cache with network_info: [{"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:19:10 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2b4c7d57-0b30-40be-8910-593bde65a7ef req-d5de595d-ec44-4caf-86d4-71581b27e95b service nova] Releasing lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:19:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-546690fc-e309-473f-887a-7c894c9ebba0 req-cf1eea57-31e6-400c-94cd-6187ad1b21ab service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-546690fc-e309-473f-887a-7c894c9ebba0 req-cf1eea57-31e6-400c-94cd-6187ad1b21ab service nova] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-546690fc-e309-473f-887a-7c894c9ebba0 req-cf1eea57-31e6-400c-94cd-6187ad1b21ab service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-546690fc-e309-473f-887a-7c894c9ebba0 req-cf1eea57-31e6-400c-94cd-6187ad1b21ab service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:11 user nova-compute[75233]: DEBUG nova.compute.manager [req-546690fc-e309-473f-887a-7c894c9ebba0 req-cf1eea57-31e6-400c-94cd-6187ad1b21ab service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] No waiting events found dispatching network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:19:11 user nova-compute[75233]: WARNING nova.compute.manager [req-546690fc-e309-473f-887a-7c894c9ebba0 req-cf1eea57-31e6-400c-94cd-6187ad1b21ab service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received unexpected event network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 for instance with vm_state building and task_state spawning.
Dec 05 14:19:12 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:19:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Instance spawned successfully.
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:19:13 user nova-compute[75233]: INFO nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Took 5.35 seconds to spawn the instance on the hypervisor.
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:19:13 user nova-compute[75233]: INFO nova.compute.manager [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Took 5.93 seconds to build instance.
Dec 05 14:19:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-87143922-1cf0-4051-94c7-84d14fb50a78 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.019s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-42e665df-9dcd-4471-abc1-4ed3662b7974 req-d17beedd-0ec3-41ac-8dc9-c8ead8a222fd service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-42e665df-9dcd-4471-abc1-4ed3662b7974 req-d17beedd-0ec3-41ac-8dc9-c8ead8a222fd service nova] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-42e665df-9dcd-4471-abc1-4ed3662b7974 req-d17beedd-0ec3-41ac-8dc9-c8ead8a222fd service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-42e665df-9dcd-4471-abc1-4ed3662b7974 req-d17beedd-0ec3-41ac-8dc9-c8ead8a222fd service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:13 user nova-compute[75233]: DEBUG nova.compute.manager [req-42e665df-9dcd-4471-abc1-4ed3662b7974 req-d17beedd-0ec3-41ac-8dc9-c8ead8a222fd service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] No waiting events found dispatching network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:19:13 user nova-compute[75233]: WARNING nova.compute.manager [req-42e665df-9dcd-4471-abc1-4ed3662b7974 req-d17beedd-0ec3-41ac-8dc9-c8ead8a222fd service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received unexpected event network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 for instance with vm_state active and task_state None.
Dec 05 14:19:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:15 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:19:16 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:19:16 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=24.882061004638672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 6ac15324-7335-4524-a93d-b51bf216d6df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dbd9a352-15f8-413a-9c75-15da44c7bcbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:19:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:19:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:18 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:19:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:19:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:19:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:19:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:19:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:19:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:19:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:19:54 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:19:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "6ac15324-7335-4524-a93d-b51bf216d6df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:00 user nova-compute[75233]: INFO nova.compute.manager [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Terminating instance
Dec 05 14:20:00 user nova-compute[75233]: DEBUG nova.compute.manager [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-b283ca58-6627-4ad8-a433-2a6dc019f674 req-f432531a-e219-49aa-bb10-195522481d62 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-vif-unplugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b283ca58-6627-4ad8-a433-2a6dc019f674 req-f432531a-e219-49aa-bb10-195522481d62 service nova] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b283ca58-6627-4ad8-a433-2a6dc019f674 req-f432531a-e219-49aa-bb10-195522481d62 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-b283ca58-6627-4ad8-a433-2a6dc019f674 req-f432531a-e219-49aa-bb10-195522481d62 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-b283ca58-6627-4ad8-a433-2a6dc019f674 req-f432531a-e219-49aa-bb10-195522481d62 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] No waiting events found dispatching network-vif-unplugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:20:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-b283ca58-6627-4ad8-a433-2a6dc019f674 req-f432531a-e219-49aa-bb10-195522481d62 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-vif-unplugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Instance destroyed successfully.
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.objects.instance [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'resources' on Instance uuid 6ac15324-7335-4524-a93d-b51bf216d6df {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1155068181',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1155068181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1155068181',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcc0qwJOhFSVaFsR7NYss0rSfvERxM5bei/nLgVVnHR2gXkFfMcqgPvFCeaF+0yxAsIOFAuvGM1k4k2qhouquOrCiaJbw67P0PrG4P/8SaPpSfMYss7q+HF+1Ay7ptz8g==',key_name='tempest-keypair-350277736',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:15:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-9n0h88w6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=6ac15324-7335-4524-a93d-b51bf216d6df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "address": "fa:16:3e:35:c9:1c", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2da675-d0", "ovs_interfaceid": "7b2da675-d0c4-45cb-9e22-23eb981519b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_vif [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b2da675-d0, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef80c3e-f065-459a-92bc-4fa92e05c3be) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:01 user nova-compute[75233]: INFO os_vif [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:c9:1c,bridge_name='br-int',has_traffic_filtering=True,id=7b2da675-d0c4-45cb-9e22-23eb981519b0,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2da675-d0')
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBwRaYED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:20:01 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c247b15-506f-4af8-a1c1-861f428b597e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:20:01 user nova-compute[75233]: No targets found.
Dec 05 14:20:01 user nova-compute[75233]: iSNS:
Dec 05 14:20:01 user nova-compute[75233]: No targets found.
Dec 05 14:20:01 user nova-compute[75233]: STATIC:
Dec 05 14:20:01 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824
Dec 05 14:20:01 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:20:01 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:20:01 user nova-compute[75233]: FIRMWARE:
Dec 05 14:20:01 user nova-compute[75233]: No targets found.
Dec 05 14:20:01 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:20:01 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:20:01 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c04dd1-ef01-4dec-b214-fcada8c2e969]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de1d9b-0218-49f1-961c-85eb5641ad5f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:20:01 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 (non-flash)
Dec 05 14:20:01 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f347411b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e88758-b210-4e17-ab2c-005dc4d8af8f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[62195321-f28c-49e9-8499-f4f5d8386930]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a37c7e-4f9b-4079-bcfa-26aac77c5a54]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[815466eb-2428-4eb6-9020-5776fd825edb]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f9b512-4cf9-491b-8983-30707c817eae]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7c5ed0-3267-4e3b-957f-90dc5317a0f6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260]
Dec 05 14:20:01 user nova-compute[75233]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824, portal: 172.16.0.220,3260] successful.
Dec 05 14:20:01 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08725345-1042-4a30-bd59-6e1260b3c824 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[63860fec-0a64-4ee8-9372-ec32d67c5e48]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== disconnect_volume: return (286ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:20:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Deleting instance files /opt/stack/data/nova/instances/6ac15324-7335-4524-a93d-b51bf216d6df_del
Dec 05 14:20:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Deletion of /opt/stack/data/nova/instances/6ac15324-7335-4524-a93d-b51bf216d6df_del complete
Dec 05 14:20:01 user nova-compute[75233]: INFO nova.compute.manager [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 05 14:20:01 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:20:01 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:20:02 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:20:02 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Took 0.88 seconds to deallocate network for instance.
Dec 05 14:20:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-6efe2a5b-19c9-453b-87ba-19b00e9d542a req-45a8f788-fc45-4ab6-9253-4667e28a4696 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-vif-deleted-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:20:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-89649ec5-d4dd-4206-a4d1-c4edbd206bc0 req-0adc4ea7-c04e-400f-b191-adb252e1a8a5 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received event network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:20:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-89649ec5-d4dd-4206-a4d1-c4edbd206bc0 req-0adc4ea7-c04e-400f-b191-adb252e1a8a5 service nova] Acquiring lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-89649ec5-d4dd-4206-a4d1-c4edbd206bc0 req-0adc4ea7-c04e-400f-b191-adb252e1a8a5 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-89649ec5-d4dd-4206-a4d1-c4edbd206bc0 req-0adc4ea7-c04e-400f-b191-adb252e1a8a5 service nova] Lock "6ac15324-7335-4524-a93d-b51bf216d6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-89649ec5-d4dd-4206-a4d1-c4edbd206bc0 req-0adc4ea7-c04e-400f-b191-adb252e1a8a5 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] No waiting events found dispatching network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:20:02 user nova-compute[75233]: WARNING nova.compute.manager [req-89649ec5-d4dd-4206-a4d1-c4edbd206bc0 req-0adc4ea7-c04e-400f-b191-adb252e1a8a5 service nova] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Received unexpected event network-vif-plugged-7b2da675-d0c4-45cb-9e22-23eb981519b0 for instance with vm_state active and task_state deleting.
Dec 05 14:20:03 user nova-compute[75233]: INFO nova.compute.manager [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Took 0.75 seconds to detach 1 volumes for instance.
Dec 05 14:20:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 6ac15324-7335-4524-a93d-b51bf216d6df] Deleting volume: 08725345-1042-4a30-bd59-6e1260b3c824 {{(pid=75233) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 14:20:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:03 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:20:03 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:20:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:03 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Deleted allocations for instance 6ac15324-7335-4524-a93d-b51bf216d6df
Dec 05 14:20:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-58aaa9ba-2d55-4135-8506-e395944a654e tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "6ac15324-7335-4524-a93d-b51bf216d6df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.148s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:16 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:20:17 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:20:17 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=24.853328704833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance dbd9a352-15f8-413a-9c75-15da44c7bcbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:20:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:19 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:19 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:20:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:20:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:20:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:20:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:20:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:20:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:20:32 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid dbd9a352-15f8-413a-9c75-15da44c7bcbe {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:20:33 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Updating instance_info_cache with network_info: [{"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:20:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-dbd9a352-15f8-413a-9c75-15da44c7bcbe" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:20:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:20:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:20:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:20:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:20:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:20:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:20:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:57 user nova-compute[75233]: INFO nova.compute.manager [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Terminating instance
Dec 05 14:20:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-c94ecea4-a698-475f-85e6-2d40352c24cf req-7aacd38d-c425-4669-a4f7-5fb61f23c1f5 service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-vif-unplugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c94ecea4-a698-475f-85e6-2d40352c24cf req-7aacd38d-c425-4669-a4f7-5fb61f23c1f5 service nova] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c94ecea4-a698-475f-85e6-2d40352c24cf req-7aacd38d-c425-4669-a4f7-5fb61f23c1f5 service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c94ecea4-a698-475f-85e6-2d40352c24cf req-7aacd38d-c425-4669-a4f7-5fb61f23c1f5 service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-c94ecea4-a698-475f-85e6-2d40352c24cf req-7aacd38d-c425-4669-a4f7-5fb61f23c1f5 service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] No waiting events found dispatching network-vif-unplugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.compute.manager [req-c94ecea4-a698-475f-85e6-2d40352c24cf req-7aacd38d-c425-4669-a4f7-5fb61f23c1f5 service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-vif-unplugged-1003ce07-aa1d-469b-8588-4317833660b0 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:20:58 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Instance destroyed successfully.
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lazy-loading 'resources' on Instance uuid dbd9a352-15f8-413a-9c75-15da44c7bcbe {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-187374086',display_name='tempest-VolumesActionsTest-instance-187374086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-187374086',id=48,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf69f7bac3fb4999b6d69e178e2f679d',ramdisk_id='',reservation_id='r-y42zrt6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-722927489',owner_user_name='tempest-VolumesActionsTest-722927489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:19:13Z,user_data=None,user_id='c253e9d5cc5a477fbf0c935dc857dfc3',uuid=dbd9a352-15f8-413a-9c75-15da44c7bcbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converting VIF {"id": "1003ce07-aa1d-469b-8588-4317833660b0", "address": "fa:16:3e:bf:09:6a", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1003ce07-aa", "ovs_interfaceid": "1003ce07-aa1d-469b-8588-4317833660b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG os_vif [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1003ce07-aa, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7dd0e16c-171d-4fb2-93e1-7e2a910a37fd) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:20:58 user nova-compute[75233]: INFO os_vif [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:6a,bridge_name='br-int',has_traffic_filtering=True,id=1003ce07-aa1d-469b-8588-4317833660b0,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1003ce07-aa')
Dec 05 14:20:58 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Deleting instance files /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe_del
Dec 05 14:20:58 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Deletion of /opt/stack/data/nova/instances/dbd9a352-15f8-413a-9c75-15da44c7bcbe_del complete
Dec 05 14:20:58 user nova-compute[75233]: INFO nova.compute.manager [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 05 14:20:58 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:20:58 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:20:59 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:20:59 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Took 0.46 seconds to deallocate network for instance.
Dec 05 14:20:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-9b3c84bc-fbc5-46ca-b0f2-830079a8479c req-3c676f1b-15ed-4621-8cd9-9e51017be679 service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-vif-deleted-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:20:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:20:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:20:59 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:20:59 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:20:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:20:59 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Deleted allocations for instance dbd9a352-15f8-413a-9c75-15da44c7bcbe
Dec 05 14:20:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-496f65b7-26de-4b98-867f-4b5c53f9c3d3 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.653s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-13baa58b-c5f1-4bdb-9320-e93ded33f2a9 req-9bfcd14d-5910-4cff-9977-36be154e64ed service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received event network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-13baa58b-c5f1-4bdb-9320-e93ded33f2a9 req-9bfcd14d-5910-4cff-9977-36be154e64ed service nova] Acquiring lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-13baa58b-c5f1-4bdb-9320-e93ded33f2a9 req-9bfcd14d-5910-4cff-9977-36be154e64ed service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-13baa58b-c5f1-4bdb-9320-e93ded33f2a9 req-9bfcd14d-5910-4cff-9977-36be154e64ed service nova] Lock "dbd9a352-15f8-413a-9c75-15da44c7bcbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-13baa58b-c5f1-4bdb-9320-e93ded33f2a9 req-9bfcd14d-5910-4cff-9977-36be154e64ed service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] No waiting events found dispatching network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:21:00 user nova-compute[75233]: WARNING nova.compute.manager [req-13baa58b-c5f1-4bdb-9320-e93ded33f2a9 req-9bfcd14d-5910-4cff-9977-36be154e64ed service nova] [instance: dbd9a352-15f8-413a-9c75-15da44c7bcbe] Received unexpected event network-vif-plugged-1003ce07-aa1d-469b-8588-4317833660b0 for instance with vm_state deleted and task_state None.
Dec 05 14:21:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:21:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:21:03 user nova-compute[75233]: INFO nova.compute.claims [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Claim successful on node user
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:21:03 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.policy [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0980778b5e4b6999590c1f311a1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cfadfed75341e8aa2e5b4f87e962d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:21:03 user nova-compute[75233]: INFO nova.virt.block_device [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Booting with volume 70281dec-7693-4b93-9a3f-db1a6a910c34 at /dev/vda
Dec 05 14:21:03 user nova-compute[75233]: DEBUG os_brick.utils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c7091-9489-41fb-b081-165323522ec9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f6a977-37a2-4a8a-8111-227d6b9e8587]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf5fbbf-c99f-4195-a60f-8606741223f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[783909e7-e610-456c-a83c-385ab7a3683c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:21:03 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:21:03 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba7d1a6-a0a0-457d-919d-6fc7ddfe76d7]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG os_brick.utils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:21:03 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating existing volume attachment record: 86e7ad75-a033-4545-a61c-4066b99fef33 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:21:04 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Successfully created port: e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Successfully updated port: e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquired lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-changed-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.compute.manager [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Refreshing instance network info cache due to event network-changed-e7765d79-9f4f-472a-84eb-fa7a66ffa19e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] Acquiring lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Releasing lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Instance network_info: |[{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] Acquired lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Refreshing network info cache for port e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updated VIF entry in instance network info cache for port e7765d79-9f4f-472a-84eb-fa7a66ffa19e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG nova.network.neutron [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:21:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-adc06109-3a6b-4b75-9abd-d5abf67db12c req-13d02170-6aae-4cf1-a903-64c99103f4e3 service nova] Releasing lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:21:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:21:12 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Creating image(s)
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Ensure instance console log exists: /opt/stack/data/nova/instances/8e894078-15d4-4696-a812-c5dba5aa1df3/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Start _get_guest_xml network_info=[{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e894078-15d4-4696-a812-c5dba5aa1df3', 'attached_at': '', 'detached_at': '', 'volume_id': '70281dec-7693-4b93-9a3f-db1a6a910c34', 'serial': '70281dec-7693-4b93-9a3f-db1a6a910c34'}, 'delete_on_termination': False, 'attachment_id': '86e7ad75-a033-4545-a61c-4066b99fef33', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:21:12 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:21:12 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:21:12 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:21:12 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:21:12 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b584e4-ad24-4c75-accb-68fc55f34e96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:21:12 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccdde20-0e08-44a4-b8e7-bebd1616f3c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34] added
Dec 05 14:21:12 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d15d0b-5786-4b1d-a0ce-aa479ad95d2d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc35f34f-e4f9-41fb-85c3-4e3c42d818c4]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdJpVjNh {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdJpVjNh" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[234126a8-d97b-4f0f-85a9-b10ac5952f12]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AdJpVjNh'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985e056-da19-483b-8b53-bb88111da591]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[465052a0-9983-425c-b6a2-0e9048dba881]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:21:12 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:21:12 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:21:12 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:21:12 user nova-compute[75233]: 
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[de57598e-aab4-4e01-bbbc-4e92688775cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:12 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]
Dec 05 14:21:12 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.
Dec 05 14:21:12 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad82ac89-68be-4800-81a6-15f8b7e3510c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67c94a7-250c-40ef-b244-31d64b353447]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:21:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:21:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835389d-6e72-4302-b7fc-b3de003f0a55]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:21:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26463666539613133', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463666539613133', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-659838831',display_name='tempest-TestVolumeBootPattern-server-659838831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-659838831',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-0px99m0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:21:03Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=8e894078-15d4-4696-a812-c5dba5aa1df3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.objects.instance [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e894078-15d4-4696-a812-c5dba5aa1df3 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:21:14 user nova-compute[75233]:   <uuid>8e894078-15d4-4696-a812-c5dba5aa1df3</uuid>
Dec 05 14:21:14 user nova-compute[75233]:   <name>instance-00000031</name>
Dec 05 14:21:14 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:21:14 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:21:14 user nova-compute[75233]:   <metadata>
Dec 05 14:21:14 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:21:14 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:21:14 user nova-compute[75233]:       <nova:name>tempest-TestVolumeBootPattern-server-659838831</nova:name>
Dec 05 14:21:14 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:21:12</nova:creationTime>
Dec 05 14:21:14 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:21:14 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:21:14 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:21:14 user nova-compute[75233]:       <nova:owner>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:user uuid="bc0980778b5e4b6999590c1f311a1c1d">tempest-TestVolumeBootPattern-1094285123-project-member</nova:user>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:project uuid="c9cfadfed75341e8aa2e5b4f87e962d9">tempest-TestVolumeBootPattern-1094285123</nova:project>
Dec 05 14:21:14 user nova-compute[75233]:       </nova:owner>
Dec 05 14:21:14 user nova-compute[75233]:       <nova:ports>
Dec 05 14:21:14 user nova-compute[75233]:         <nova:port uuid="e7765d79-9f4f-472a-84eb-fa7a66ffa19e">
Dec 05 14:21:14 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 14:21:14 user nova-compute[75233]:         </nova:port>
Dec 05 14:21:14 user nova-compute[75233]:       </nova:ports>
Dec 05 14:21:14 user nova-compute[75233]:     </nova:instance>
Dec 05 14:21:14 user nova-compute[75233]:   </metadata>
Dec 05 14:21:14 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:21:14 user nova-compute[75233]:     <system>
Dec 05 14:21:14 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:21:14 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:21:14 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:21:14 user nova-compute[75233]:       <entry name="serial">8e894078-15d4-4696-a812-c5dba5aa1df3</entry>
Dec 05 14:21:14 user nova-compute[75233]:       <entry name="uuid">8e894078-15d4-4696-a812-c5dba5aa1df3</entry>
Dec 05 14:21:14 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:21:14 user nova-compute[75233]:     </system>
Dec 05 14:21:14 user nova-compute[75233]:   </sysinfo>
Dec 05 14:21:14 user nova-compute[75233]:   <os>
Dec 05 14:21:14 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:21:14 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:21:14 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:21:14 user nova-compute[75233]:   </os>
Dec 05 14:21:14 user nova-compute[75233]:   <features>
Dec 05 14:21:14 user nova-compute[75233]:     <acpi/>
Dec 05 14:21:14 user nova-compute[75233]:     <apic/>
Dec 05 14:21:14 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:21:14 user nova-compute[75233]:   </features>
Dec 05 14:21:14 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:21:14 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:21:14 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:21:14 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:21:14 user nova-compute[75233]:   </clock>
Dec 05 14:21:14 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:21:14 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:21:14 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:21:14 user nova-compute[75233]:   </cpu>
Dec 05 14:21:14 user nova-compute[75233]:   <devices>
Dec 05 14:21:14 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:21:14 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:21:14 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 14:21:14 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:21:14 user nova-compute[75233]:       <serial>70281dec-7693-4b93-9a3f-db1a6a910c34</serial>
Dec 05 14:21:14 user nova-compute[75233]:     </disk>
Dec 05 14:21:14 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:21:14 user nova-compute[75233]:       <mac address="fa:16:3e:24:ff:a1"/>
Dec 05 14:21:14 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:21:14 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:21:14 user nova-compute[75233]:       <target dev="tape7765d79-9f"/>
Dec 05 14:21:14 user nova-compute[75233]:     </interface>
Dec 05 14:21:14 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:21:14 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/8e894078-15d4-4696-a812-c5dba5aa1df3/console.log" append="off"/>
Dec 05 14:21:14 user nova-compute[75233]:     </serial>
Dec 05 14:21:14 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:21:14 user nova-compute[75233]:     <video>
Dec 05 14:21:14 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:21:14 user nova-compute[75233]:     </video>
Dec 05 14:21:14 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:21:14 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:21:14 user nova-compute[75233]:     </rng>
Dec 05 14:21:14 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:21:14 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:21:14 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:21:14 user nova-compute[75233]:     </memballoon>
Dec 05 14:21:14 user nova-compute[75233]:   </devices>
Dec 05 14:21:14 user nova-compute[75233]: </domain>
Dec 05 14:21:14 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-659838831',display_name='tempest-TestVolumeBootPattern-server-659838831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-659838831',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-0px99m0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:21:03Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=8e894078-15d4-4696-a812-c5dba5aa1df3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG os_vif [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80b721fd-cdf7-5dae-a1d5-4d6ce8eb88e4', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7765d79-9f, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7765d79-9f, col_values=(('qos', UUID('e7d354c8-e61c-4581-b9c1-889464d42d74')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7765d79-9f, col_values=(('external_ids', {'iface-id': 'e7765d79-9f4f-472a-84eb-fa7a66ffa19e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:ff:a1', 'vm-uuid': '8e894078-15d4-4696-a812-c5dba5aa1df3'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:14 user nova-compute[75233]: INFO os_vif [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f')
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No VIF found with MAC fa:16:3e:24:ff:a1, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-ab8b8a08-aa59-401c-b8c9-a7b8f6d4e413 req-6bd5f300-e7f2-4966-b86d-7970d344619f service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ab8b8a08-aa59-401c-b8c9-a7b8f6d4e413 req-6bd5f300-e7f2-4966-b86d-7970d344619f service nova] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ab8b8a08-aa59-401c-b8c9-a7b8f6d4e413 req-6bd5f300-e7f2-4966-b86d-7970d344619f service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ab8b8a08-aa59-401c-b8c9-a7b8f6d4e413 req-6bd5f300-e7f2-4966-b86d-7970d344619f service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:15 user nova-compute[75233]: DEBUG nova.compute.manager [req-ab8b8a08-aa59-401c-b8c9-a7b8f6d4e413 req-6bd5f300-e7f2-4966-b86d-7970d344619f service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] No waiting events found dispatching network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:21:15 user nova-compute[75233]: WARNING nova.compute.manager [req-ab8b8a08-aa59-401c-b8c9-a7b8f6d4e413 req-6bd5f300-e7f2-4966-b86d-7970d344619f service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received unexpected event network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e for instance with vm_state building and task_state spawning.
Dec 05 14:21:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:21:17 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Instance spawned successfully.
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:17 user nova-compute[75233]: INFO nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Took 4.81 seconds to spawn the instance on the hypervisor.
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:21:17 user nova-compute[75233]: INFO nova.compute.manager [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Took 14.66 seconds to build instance.
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c37efbb-f301-4c86-9f54-611d30cd50de req-eed84e69-80f3-48f9-bf3c-f7af459c275c service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c37efbb-f301-4c86-9f54-611d30cd50de req-eed84e69-80f3-48f9-bf3c-f7af459c275c service nova] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c37efbb-f301-4c86-9f54-611d30cd50de req-eed84e69-80f3-48f9-bf3c-f7af459c275c service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-4c37efbb-f301-4c86-9f54-611d30cd50de req-eed84e69-80f3-48f9-bf3c-f7af459c275c service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:17 user nova-compute[75233]: DEBUG nova.compute.manager [req-4c37efbb-f301-4c86-9f54-611d30cd50de req-eed84e69-80f3-48f9-bf3c-f7af459c275c service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] No waiting events found dispatching network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:21:17 user nova-compute[75233]: WARNING nova.compute.manager [req-4c37efbb-f301-4c86-9f54-611d30cd50de req-eed84e69-80f3-48f9-bf3c-f7af459c275c service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received unexpected event network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e for instance with vm_state active and task_state None.
Dec 05 14:21:17 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-b6e799d1-25a5-49ae-986c-1e84d3e77df6 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.744s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:18 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:21:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:21:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:21:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=24.87895965576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 8e894078-15d4-4696-a812-c5dba5aa1df3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:21:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:20 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:21:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:24 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:21:34 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 8e894078-15d4-4696-a812-c5dba5aa1df3 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:21:35 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:21:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:21:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:21:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:39 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:44 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "b0e1bffd-246b-4618-9293-06496724b9f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:21:49 user nova-compute[75233]: INFO nova.compute.claims [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Claim successful on node user
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:21:49 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.policy [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c253e9d5cc5a477fbf0c935dc857dfc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf69f7bac3fb4999b6d69e178e2f679d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:21:49 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Creating image(s)
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "/opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "/opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.170s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.174s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk 1073741824" returned: 0 in 0.053s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Successfully created port: ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Cannot resize image /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Ensure instance console log exists: /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Successfully updated port: ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquired lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-changed-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.compute.manager [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Refreshing instance network info cache due to event network-changed-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] Acquiring lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updating instance_info_cache with network_info: [{"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Releasing lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Instance network_info: |[{"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] Acquired lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.neutron [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Refreshing network info cache for port ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Start _get_guest_xml network_info=[{"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:21:51 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:21:51 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-68721189',display_name='tempest-VolumesActionsTest-instance-68721189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-68721189',id=50,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf69f7bac3fb4999b6d69e178e2f679d',ramdisk_id='',reservation_id='r-xvghjmch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-722927489',owner_user_name='tempest-VolumesActionsTest-722927489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:21:50Z,user_data=None,user_id='c253e9d5cc5a477fbf0c935dc857dfc3',uuid=b0e1bffd-246b-4618-9293-06496724b9f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converting VIF {"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.objects.instance [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lazy-loading 'pci_devices' on Instance uuid b0e1bffd-246b-4618-9293-06496724b9f6 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:21:51 user nova-compute[75233]:   <uuid>b0e1bffd-246b-4618-9293-06496724b9f6</uuid>
Dec 05 14:21:51 user nova-compute[75233]:   <name>instance-00000032</name>
Dec 05 14:21:51 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:21:51 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:21:51 user nova-compute[75233]:   <metadata>
Dec 05 14:21:51 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:21:51 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:21:51 user nova-compute[75233]:       <nova:name>tempest-VolumesActionsTest-instance-68721189</nova:name>
Dec 05 14:21:51 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:21:51</nova:creationTime>
Dec 05 14:21:51 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:21:51 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:21:51 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:21:51 user nova-compute[75233]:       <nova:owner>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:user uuid="c253e9d5cc5a477fbf0c935dc857dfc3">tempest-VolumesActionsTest-722927489-project-member</nova:user>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:project uuid="cf69f7bac3fb4999b6d69e178e2f679d">tempest-VolumesActionsTest-722927489</nova:project>
Dec 05 14:21:51 user nova-compute[75233]:       </nova:owner>
Dec 05 14:21:51 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:21:51 user nova-compute[75233]:       <nova:ports>
Dec 05 14:21:51 user nova-compute[75233]:         <nova:port uuid="ebfedd3d-b7b5-493e-bdb8-7c454c13b81d">
Dec 05 14:21:51 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 05 14:21:51 user nova-compute[75233]:         </nova:port>
Dec 05 14:21:51 user nova-compute[75233]:       </nova:ports>
Dec 05 14:21:51 user nova-compute[75233]:     </nova:instance>
Dec 05 14:21:51 user nova-compute[75233]:   </metadata>
Dec 05 14:21:51 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:21:51 user nova-compute[75233]:     <system>
Dec 05 14:21:51 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:21:51 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:21:51 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:21:51 user nova-compute[75233]:       <entry name="serial">b0e1bffd-246b-4618-9293-06496724b9f6</entry>
Dec 05 14:21:51 user nova-compute[75233]:       <entry name="uuid">b0e1bffd-246b-4618-9293-06496724b9f6</entry>
Dec 05 14:21:51 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:21:51 user nova-compute[75233]:     </system>
Dec 05 14:21:51 user nova-compute[75233]:   </sysinfo>
Dec 05 14:21:51 user nova-compute[75233]:   <os>
Dec 05 14:21:51 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:21:51 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:21:51 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:21:51 user nova-compute[75233]:   </os>
Dec 05 14:21:51 user nova-compute[75233]:   <features>
Dec 05 14:21:51 user nova-compute[75233]:     <acpi/>
Dec 05 14:21:51 user nova-compute[75233]:     <apic/>
Dec 05 14:21:51 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:21:51 user nova-compute[75233]:   </features>
Dec 05 14:21:51 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:21:51 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:21:51 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:21:51 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:21:51 user nova-compute[75233]:   </clock>
Dec 05 14:21:51 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:21:51 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:21:51 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:21:51 user nova-compute[75233]:   </cpu>
Dec 05 14:21:51 user nova-compute[75233]:   <devices>
Dec 05 14:21:51 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:21:51 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:21:51 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk"/>
Dec 05 14:21:51 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:21:51 user nova-compute[75233]:     </disk>
Dec 05 14:21:51 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:21:51 user nova-compute[75233]:       <mac address="fa:16:3e:31:ec:c0"/>
Dec 05 14:21:51 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:21:51 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:21:51 user nova-compute[75233]:       <target dev="tapebfedd3d-b7"/>
Dec 05 14:21:51 user nova-compute[75233]:     </interface>
Dec 05 14:21:51 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:21:51 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/console.log" append="off"/>
Dec 05 14:21:51 user nova-compute[75233]:     </serial>
Dec 05 14:21:51 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:21:51 user nova-compute[75233]:     <video>
Dec 05 14:21:51 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:21:51 user nova-compute[75233]:     </video>
Dec 05 14:21:51 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:21:51 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:21:51 user nova-compute[75233]:     </rng>
Dec 05 14:21:51 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:21:51 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:21:51 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:21:51 user nova-compute[75233]:     </memballoon>
Dec 05 14:21:51 user nova-compute[75233]:   </devices>
Dec 05 14:21:51 user nova-compute[75233]: </domain>
Dec 05 14:21:51 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-68721189',display_name='tempest-VolumesActionsTest-instance-68721189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-68721189',id=50,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf69f7bac3fb4999b6d69e178e2f679d',ramdisk_id='',reservation_id='r-xvghjmch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-722927489',owner_user_name='tempest-VolumesActionsTest-722927489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:21:50Z,user_data=None,user_id='c253e9d5cc5a477fbf0c935dc857dfc3',uuid=b0e1bffd-246b-4618-9293-06496724b9f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converting VIF {"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG os_vif [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c06e473-323b-518a-b567-16015c0faa3d', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebfedd3d-b7, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebfedd3d-b7, col_values=(('qos', UUID('52704228-a714-42e0-ba2c-09863a309c68')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebfedd3d-b7, col_values=(('external_ids', {'iface-id': 'ebfedd3d-b7b5-493e-bdb8-7c454c13b81d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:ec:c0', 'vm-uuid': 'b0e1bffd-246b-4618-9293-06496724b9f6'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:51 user nova-compute[75233]: INFO os_vif [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7')
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:21:51 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] No VIF found with MAC fa:16:3e:31:ec:c0, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:21:52 user nova-compute[75233]: DEBUG nova.network.neutron [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updated VIF entry in instance network info cache for port ebfedd3d-b7b5-493e-bdb8-7c454c13b81d. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:21:52 user nova-compute[75233]: DEBUG nova.network.neutron [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updating instance_info_cache with network_info: [{"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:21:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-0bdf74ff-af5d-49c9-a85d-b36529a24816 req-ae929fa4-ed34-4928-a42c-f1b19d3867ac service nova] Releasing lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-2c0622dd-6465-4ce9-afdd-675a4eba2c4f req-bb5eb890-f166-4a82-92c1-16fc60570cf8 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c0622dd-6465-4ce9-afdd-675a4eba2c4f req-bb5eb890-f166-4a82-92c1-16fc60570cf8 service nova] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c0622dd-6465-4ce9-afdd-675a4eba2c4f req-bb5eb890-f166-4a82-92c1-16fc60570cf8 service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-2c0622dd-6465-4ce9-afdd-675a4eba2c4f req-bb5eb890-f166-4a82-92c1-16fc60570cf8 service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG nova.compute.manager [req-2c0622dd-6465-4ce9-afdd-675a4eba2c4f req-bb5eb890-f166-4a82-92c1-16fc60570cf8 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] No waiting events found dispatching network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:21:53 user nova-compute[75233]: WARNING nova.compute.manager [req-2c0622dd-6465-4ce9-afdd-675a4eba2c4f req-bb5eb890-f166-4a82-92c1-16fc60570cf8 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received unexpected event network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d for instance with vm_state building and task_state spawning.
Dec 05 14:21:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:21:55 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Instance spawned successfully.
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:21:55 user nova-compute[75233]: INFO nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Took 5.50 seconds to spawn the instance on the hypervisor.
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-f467a3cb-6901-4fab-916c-afe0f8c20a5c req-763bdea8-d1ab-4fd5-9e9c-09bd12899f9e service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f467a3cb-6901-4fab-916c-afe0f8c20a5c req-763bdea8-d1ab-4fd5-9e9c-09bd12899f9e service nova] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f467a3cb-6901-4fab-916c-afe0f8c20a5c req-763bdea8-d1ab-4fd5-9e9c-09bd12899f9e service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-f467a3cb-6901-4fab-916c-afe0f8c20a5c req-763bdea8-d1ab-4fd5-9e9c-09bd12899f9e service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-f467a3cb-6901-4fab-916c-afe0f8c20a5c req-763bdea8-d1ab-4fd5-9e9c-09bd12899f9e service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] No waiting events found dispatching network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:21:55 user nova-compute[75233]: WARNING nova.compute.manager [req-f467a3cb-6901-4fab-916c-afe0f8c20a5c req-763bdea8-d1ab-4fd5-9e9c-09bd12899f9e service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received unexpected event network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d for instance with vm_state building and task_state spawning.
Dec 05 14:21:55 user nova-compute[75233]: INFO nova.compute.manager [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Took 6.00 seconds to build instance.
Dec 05 14:21:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-a45de8ac-1a8f-488a-bdce-e634493767a7 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "b0e1bffd-246b-4618-9293-06496724b9f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.141s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:21:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:21:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:22:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:22:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:22:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:22:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:11 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:14 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:22:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=24.849563598632812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 8e894078-15d4-4696-a812-c5dba5aa1df3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b0e1bffd-246b-4618-9293-06496724b9f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:22:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:22:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:21 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:22 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:22:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:22:35 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 8e894078-15d4-4696-a812-c5dba5aa1df3 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:22:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:22:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:22:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:22:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:22:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-changed-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG nova.compute.manager [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Refreshing instance network info cache due to event network-changed-e7765d79-9f4f-472a-84eb-fa7a66ffa19e. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] Acquiring lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] Acquired lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG nova.network.neutron [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Refreshing network info cache for port e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG nova.network.neutron [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updated VIF entry in instance network info cache for port e7765d79-9f4f-472a-84eb-fa7a66ffa19e. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG nova.network.neutron [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [{"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-35db423b-9c8f-4334-8c35-9c5394e8aff9 req-15f8ce2f-1ede-469a-92a2-bc3d2b97eed9 service nova] Releasing lock "refresh_cache-8e894078-15d4-4696-a812-c5dba5aa1df3" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:22:55 user nova-compute[75233]: INFO nova.compute.manager [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Terminating instance
Dec 05 14:22:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Instance destroyed successfully.
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.objects.instance [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'resources' on Instance uuid 8e894078-15d4-4696-a812-c5dba5aa1df3 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-659838831',display_name='tempest-TestVolumeBootPattern-server-659838831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-659838831',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-0px99m0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:21:18Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=8e894078-15d4-4696-a812-c5dba5aa1df3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "address": "fa:16:3e:24:ff:a1", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7765d79-9f", "ovs_interfaceid": "e7765d79-9f4f-472a-84eb-fa7a66ffa19e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_vif [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7765d79-9f, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7d354c8-e61c-4581-b9c1-889464d42d74) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:22:56 user nova-compute[75233]: INFO os_vif [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:ff:a1,bridge_name='br-int',has_traffic_filtering=True,id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7765d79-9f')
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:22:56 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c82016-0628-4bed-bccc-e54522963f88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:22:56 user nova-compute[75233]: No targets found.
Dec 05 14:22:56 user nova-compute[75233]: iSNS:
Dec 05 14:22:56 user nova-compute[75233]: No targets found.
Dec 05 14:22:56 user nova-compute[75233]: STATIC:
Dec 05 14:22:56 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34
Dec 05 14:22:56 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:22:56 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:22:56 user nova-compute[75233]: FIRMWARE:
Dec 05 14:22:56 user nova-compute[75233]: No targets found.
Dec 05 14:22:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:22:56 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:22:56 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a31e39-f320-47f0-9e51-dcaa8139bf5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c74f3-2582-4a22-a05e-fe8cfde51ca0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:22:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:22:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f586a8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320cbbc-13e4-4031-bf4c-070c60ce3567]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b8def2-9159-416b-bcb7-7bab30affa36]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56873e4-fe6c-4cb3-95e4-299b5f6af7d8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046b10e-01e4-4c2c-a0d1-e2a816b132b2]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a4983d79', '/dev/disk/by-id/scsi-26463666539613133', '/dev/disk/by-id/scsi-1SCST_BIOa4983d79-dcfe9a13f64e34f8') {{(pid=86205) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d3a92-5dbe-4e24-9ba5-fdf05174f49a]: (4, None) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f2fc61-15bf-43f1-a760-70a5c13402a1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0ae7a3-a80e-45a2-98b9-47e93266febb]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]
Dec 05 14:22:56 user nova-compute[75233]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.
Dec 05 14:22:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff7510-8b19-49e1-872f-d38ddd67fbc1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== disconnect_volume: return (307ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:22:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Deleting instance files /opt/stack/data/nova/instances/8e894078-15d4-4696-a812-c5dba5aa1df3_del
Dec 05 14:22:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Deletion of /opt/stack/data/nova/instances/8e894078-15d4-4696-a812-c5dba5aa1df3_del complete
Dec 05 14:22:56 user nova-compute[75233]: INFO nova.compute.manager [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 05 14:22:56 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:22:56 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-vif-unplugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] No waiting events found dispatching network-vif-unplugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-vif-unplugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] Acquiring lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] No waiting events found dispatching network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:22:57 user nova-compute[75233]: WARNING nova.compute.manager [req-7b4fc26b-7c61-49f4-9252-5beb869361af req-b64d6d5b-8c1e-4266-8650-95b78130c76d service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received unexpected event network-vif-plugged-e7765d79-9f4f-472a-84eb-fa7a66ffa19e for instance with vm_state active and task_state deleting.
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:22:57 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Took 0.67 seconds to deallocate network for instance.
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-15c7f9f9-2431-4bc7-aea1-73d782c2ccba req-10bd25f6-b7d9-4c0d-aaba-4ffb0b17e292 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Received event network-vif-deleted-e7765d79-9f4f-472a-84eb-fa7a66ffa19e {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:22:57 user nova-compute[75233]: INFO nova.compute.manager [req-15c7f9f9-2431-4bc7-aea1-73d782c2ccba req-10bd25f6-b7d9-4c0d-aaba-4ffb0b17e292 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Neutron deleted interface e7765d79-9f4f-472a-84eb-fa7a66ffa19e; detaching it from the instance and deleting it from the info cache
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.network.neutron [req-15c7f9f9-2431-4bc7-aea1-73d782c2ccba req-10bd25f6-b7d9-4c0d-aaba-4ffb0b17e292 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:22:57 user nova-compute[75233]: DEBUG nova.compute.manager [req-15c7f9f9-2431-4bc7-aea1-73d782c2ccba req-10bd25f6-b7d9-4c0d-aaba-4ffb0b17e292 service nova] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Detach interface failed, port_id=e7765d79-9f4f-472a-84eb-fa7a66ffa19e, reason: Instance 8e894078-15d4-4696-a812-c5dba5aa1df3 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:22:58 user nova-compute[75233]: INFO nova.compute.manager [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 8e894078-15d4-4696-a812-c5dba5aa1df3] Took 0.78 seconds to detach 1 volumes for instance.
Dec 05 14:22:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:22:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:22:58 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:22:58 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:22:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:22:58 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Deleted allocations for instance 8e894078-15d4-4696-a812-c5dba5aa1df3
Dec 05 14:22:58 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-74187012-8a68-4212-a57f-20fac52930e8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "8e894078-15d4-4696-a812-c5dba5aa1df3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.939s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:13 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:18 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:23:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:23:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.848468780517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b0e1bffd-246b-4618-9293-06496724b9f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:23:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:23 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:23:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:23:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:23:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:23:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:23:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:23:38 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updating instance_info_cache with network_info: [{"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:23:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b0e1bffd-246b-4618-9293-06496724b9f6" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:23:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:23:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "b0e1bffd-246b-4618-9293-06496724b9f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:39 user nova-compute[75233]: INFO nova.compute.manager [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Terminating instance
Dec 05 14:23:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-e25fd9d1-5c06-49a8-9295-542e27aeea27 req-03e0acef-0e02-4628-b20a-0fbdaf33303d service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-vif-unplugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e25fd9d1-5c06-49a8-9295-542e27aeea27 req-03e0acef-0e02-4628-b20a-0fbdaf33303d service nova] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e25fd9d1-5c06-49a8-9295-542e27aeea27 req-03e0acef-0e02-4628-b20a-0fbdaf33303d service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e25fd9d1-5c06-49a8-9295-542e27aeea27 req-03e0acef-0e02-4628-b20a-0fbdaf33303d service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-e25fd9d1-5c06-49a8-9295-542e27aeea27 req-03e0acef-0e02-4628-b20a-0fbdaf33303d service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] No waiting events found dispatching network-vif-unplugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-e25fd9d1-5c06-49a8-9295-542e27aeea27 req-03e0acef-0e02-4628-b20a-0fbdaf33303d service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-vif-unplugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:23:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Instance destroyed successfully.
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lazy-loading 'resources' on Instance uuid b0e1bffd-246b-4618-9293-06496724b9f6 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-68721189',display_name='tempest-VolumesActionsTest-instance-68721189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-68721189',id=50,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:21:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf69f7bac3fb4999b6d69e178e2f679d',ramdisk_id='',reservation_id='r-xvghjmch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-722927489',owner_user_name='tempest-VolumesActionsTest-722927489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:21:55Z,user_data=None,user_id='c253e9d5cc5a477fbf0c935dc857dfc3',uuid=b0e1bffd-246b-4618-9293-06496724b9f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converting VIF {"id": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "address": "fa:16:3e:31:ec:c0", "network": {"id": "d30ba0bb-d41a-4efa-8ff0-56f340123a10", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797030174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf69f7bac3fb4999b6d69e178e2f679d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfedd3d-b7", "ovs_interfaceid": "ebfedd3d-b7b5-493e-bdb8-7c454c13b81d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG os_vif [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebfedd3d-b7, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52704228-a714-42e0-ba2c-09863a309c68) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:40 user nova-compute[75233]: INFO os_vif [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ec:c0,bridge_name='br-int',has_traffic_filtering=True,id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d,network=Network(d30ba0bb-d41a-4efa-8ff0-56f340123a10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfedd3d-b7')
Dec 05 14:23:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Deleting instance files /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6_del
Dec 05 14:23:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Deletion of /opt/stack/data/nova/instances/b0e1bffd-246b-4618-9293-06496724b9f6_del complete
Dec 05 14:23:40 user nova-compute[75233]: INFO nova.compute.manager [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 05 14:23:40 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:23:40 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:23:41 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Took 0.43 seconds to deallocate network for instance.
Dec 05 14:23:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-65669671-f26f-4af3-86a2-e49866657798 req-93f8e371-8415-450d-8f85-e2f824aa31d0 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-vif-deleted-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:23:41 user nova-compute[75233]: INFO nova.compute.manager [req-65669671-f26f-4af3-86a2-e49866657798 req-93f8e371-8415-450d-8f85-e2f824aa31d0 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Neutron deleted interface ebfedd3d-b7b5-493e-bdb8-7c454c13b81d; detaching it from the instance and deleting it from the info cache
Dec 05 14:23:41 user nova-compute[75233]: DEBUG nova.network.neutron [req-65669671-f26f-4af3-86a2-e49866657798 req-93f8e371-8415-450d-8f85-e2f824aa31d0 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG nova.compute.manager [req-65669671-f26f-4af3-86a2-e49866657798 req-93f8e371-8415-450d-8f85-e2f824aa31d0 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Detach interface failed, port_id=ebfedd3d-b7b5-493e-bdb8-7c454c13b81d, reason: Instance b0e1bffd-246b-4618-9293-06496724b9f6 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:23:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:41 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Deleted allocations for instance b0e1bffd-246b-4618-9293-06496724b9f6
Dec 05 14:23:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1ae4fb88-85e4-4258-88a0-cc92a5744488 tempest-VolumesActionsTest-722927489 tempest-VolumesActionsTest-722927489-project-member] Lock "b0e1bffd-246b-4618-9293-06496724b9f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.597s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-5e11f38b-3cb5-473d-a5d0-3d785d42653e req-b22875d3-c91e-4da1-92c4-666c704c52e1 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received event network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:23:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5e11f38b-3cb5-473d-a5d0-3d785d42653e req-b22875d3-c91e-4da1-92c4-666c704c52e1 service nova] Acquiring lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5e11f38b-3cb5-473d-a5d0-3d785d42653e req-b22875d3-c91e-4da1-92c4-666c704c52e1 service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5e11f38b-3cb5-473d-a5d0-3d785d42653e req-b22875d3-c91e-4da1-92c4-666c704c52e1 service nova] Lock "b0e1bffd-246b-4618-9293-06496724b9f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-5e11f38b-3cb5-473d-a5d0-3d785d42653e req-b22875d3-c91e-4da1-92c4-666c704c52e1 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] No waiting events found dispatching network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:23:42 user nova-compute[75233]: WARNING nova.compute.manager [req-5e11f38b-3cb5-473d-a5d0-3d785d42653e req-b22875d3-c91e-4da1-92c4-666c704c52e1 service nova] [instance: b0e1bffd-246b-4618-9293-06496724b9f6] Received unexpected event network-vif-plugged-ebfedd3d-b7b5-493e-bdb8-7c454c13b81d for instance with vm_state deleted and task_state None.
Dec 05 14:23:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:23:47 user nova-compute[75233]: INFO nova.compute.claims [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Claim successful on node user
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:23:47 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.policy [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0980778b5e4b6999590c1f311a1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cfadfed75341e8aa2e5b4f87e962d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:23:47 user nova-compute[75233]: INFO nova.virt.block_device [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Booting with volume 70281dec-7693-4b93-9a3f-db1a6a910c34 at /dev/vda
Dec 05 14:23:47 user nova-compute[75233]: DEBUG os_brick.utils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef756183-4a40-4d09-86d2-fa9bd6cb1f29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec0dbc-5307-4d30-a9f2-0c7b7c790934]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d546ef1-6235-4404-9054-3bc0bf0d49b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13a97e0-acf1-48d8-a8f0-487f6d7214df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:23:47 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:23:47 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f07f47a-33f0-465d-bba9-21a648c734eb]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG os_brick.utils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:23:47 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating existing volume attachment record: b561d5b6-8590-49ec-859e-05c0a5dfe075 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:23:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Successfully created port: 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:23:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Successfully updated port: 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:23:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:23:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:23:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-changed-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Refreshing instance network info cache due to event network-changed-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Instance network_info: |[{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Refreshing network info cache for port 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updated VIF entry in instance network info cache for port 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:23:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-33569d58-0a38-4196-b6ff-5a91d36a0d19 req-573e08aa-009c-4a58-903e-b64071d1ea9c service nova] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:23:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:23:56 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Creating image(s)
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Ensure instance console log exists: /opt/stack/data/nova/instances/378bc083-4b06-45d1-8b49-cdeba4ee8ff4/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Start _get_guest_xml network_info=[{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '378bc083-4b06-45d1-8b49-cdeba4ee8ff4', 'attached_at': '', 'detached_at': '', 'volume_id': '70281dec-7693-4b93-9a3f-db1a6a910c34', 'serial': '70281dec-7693-4b93-9a3f-db1a6a910c34'}, 'delete_on_termination': False, 'attachment_id': 'b561d5b6-8590-49ec-859e-05c0a5dfe075', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:23:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:23:56 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:23:56 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:23:56 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:23:56 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf552b-c800-4ef7-a0b4-ad4178df6fa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:23:56 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c395f8-de53-4066-a271-ae2e8d38fbea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34] added
Dec 05 14:23:56 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d021ae-cb7a-45c7-a465-f98774d13fcc]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a8ba54-eac6-4bd5-ac1e-a70655fddf9b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdJpVjNh {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdJpVjNh" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1446d1-8919-4c31-abd7-29180afabac3]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AdJpVjNh'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:56 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aca25b-5a1f-4166-8a0d-e2355e97a95a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb19ac6-86e8-4187-9515-45ebb62cc17c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:23:57 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:23:57 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:23:57 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:23:57 user nova-compute[75233]: 
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7def2c4-6fa9-4779-a345-dbb22146038f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]
Dec 05 14:23:57 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.
Dec 05 14:23:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4003f-a4f8-4d8a-81aa-35f440668db1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[777714c5-f6fc-45a7-9b93-9bef953ec527]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:23:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:23:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[588de553-56bf-4dc3-a549-132b504f6ad5]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:23:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26463666539613133', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463666539613133', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1822975577',display_name='tempest-TestVolumeBootPattern-server-1822975577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1822975577',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-0hglcsyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:23:48Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=378bc083-4b06-45d1-8b49-cdeba4ee8ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'pci_devices' on Instance uuid 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:23:58 user nova-compute[75233]:   <uuid>378bc083-4b06-45d1-8b49-cdeba4ee8ff4</uuid>
Dec 05 14:23:58 user nova-compute[75233]:   <name>instance-00000033</name>
Dec 05 14:23:58 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:23:58 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:23:58 user nova-compute[75233]:   <metadata>
Dec 05 14:23:58 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:23:58 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:23:58 user nova-compute[75233]:       <nova:name>tempest-TestVolumeBootPattern-server-1822975577</nova:name>
Dec 05 14:23:58 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:23:56</nova:creationTime>
Dec 05 14:23:58 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:23:58 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:23:58 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:23:58 user nova-compute[75233]:       <nova:owner>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:user uuid="bc0980778b5e4b6999590c1f311a1c1d">tempest-TestVolumeBootPattern-1094285123-project-member</nova:user>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:project uuid="c9cfadfed75341e8aa2e5b4f87e962d9">tempest-TestVolumeBootPattern-1094285123</nova:project>
Dec 05 14:23:58 user nova-compute[75233]:       </nova:owner>
Dec 05 14:23:58 user nova-compute[75233]:       <nova:ports>
Dec 05 14:23:58 user nova-compute[75233]:         <nova:port uuid="6a6e945c-b2f1-4f98-b576-1d82a0c5ab79">
Dec 05 14:23:58 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 14:23:58 user nova-compute[75233]:         </nova:port>
Dec 05 14:23:58 user nova-compute[75233]:       </nova:ports>
Dec 05 14:23:58 user nova-compute[75233]:     </nova:instance>
Dec 05 14:23:58 user nova-compute[75233]:   </metadata>
Dec 05 14:23:58 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:23:58 user nova-compute[75233]:     <system>
Dec 05 14:23:58 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:23:58 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:23:58 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:23:58 user nova-compute[75233]:       <entry name="serial">378bc083-4b06-45d1-8b49-cdeba4ee8ff4</entry>
Dec 05 14:23:58 user nova-compute[75233]:       <entry name="uuid">378bc083-4b06-45d1-8b49-cdeba4ee8ff4</entry>
Dec 05 14:23:58 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:23:58 user nova-compute[75233]:     </system>
Dec 05 14:23:58 user nova-compute[75233]:   </sysinfo>
Dec 05 14:23:58 user nova-compute[75233]:   <os>
Dec 05 14:23:58 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:23:58 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:23:58 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:23:58 user nova-compute[75233]:   </os>
Dec 05 14:23:58 user nova-compute[75233]:   <features>
Dec 05 14:23:58 user nova-compute[75233]:     <acpi/>
Dec 05 14:23:58 user nova-compute[75233]:     <apic/>
Dec 05 14:23:58 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:23:58 user nova-compute[75233]:   </features>
Dec 05 14:23:58 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:23:58 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:23:58 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:23:58 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:23:58 user nova-compute[75233]:   </clock>
Dec 05 14:23:58 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:23:58 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:23:58 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:23:58 user nova-compute[75233]:   </cpu>
Dec 05 14:23:58 user nova-compute[75233]:   <devices>
Dec 05 14:23:58 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:23:58 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:23:58 user nova-compute[75233]:       <source dev="/dev/sdb"/>
Dec 05 14:23:58 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:23:58 user nova-compute[75233]:       <serial>70281dec-7693-4b93-9a3f-db1a6a910c34</serial>
Dec 05 14:23:58 user nova-compute[75233]:     </disk>
Dec 05 14:23:58 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:23:58 user nova-compute[75233]:       <mac address="fa:16:3e:1b:68:a8"/>
Dec 05 14:23:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:23:58 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:23:58 user nova-compute[75233]:       <target dev="tap6a6e945c-b2"/>
Dec 05 14:23:58 user nova-compute[75233]:     </interface>
Dec 05 14:23:58 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:23:58 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/378bc083-4b06-45d1-8b49-cdeba4ee8ff4/console.log" append="off"/>
Dec 05 14:23:58 user nova-compute[75233]:     </serial>
Dec 05 14:23:58 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:23:58 user nova-compute[75233]:     <video>
Dec 05 14:23:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:23:58 user nova-compute[75233]:     </video>
Dec 05 14:23:58 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:23:58 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:23:58 user nova-compute[75233]:     </rng>
Dec 05 14:23:58 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:23:58 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:23:58 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:23:58 user nova-compute[75233]:     </memballoon>
Dec 05 14:23:58 user nova-compute[75233]:   </devices>
Dec 05 14:23:58 user nova-compute[75233]: </domain>
Dec 05 14:23:58 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1822975577',display_name='tempest-TestVolumeBootPattern-server-1822975577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1822975577',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-0hglcsyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:23:48Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=378bc083-4b06-45d1-8b49-cdeba4ee8ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG os_vif [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83b93dc2-5acf-5898-8a24-9ee4c7511261', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a6e945c-b2, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a6e945c-b2, col_values=(('qos', UUID('6e4c2308-a9e4-4a79-bba3-07da5d3043c6')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a6e945c-b2, col_values=(('external_ids', {'iface-id': '6a6e945c-b2f1-4f98-b576-1d82a0c5ab79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:68:a8', 'vm-uuid': '378bc083-4b06-45d1-8b49-cdeba4ee8ff4'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:58 user nova-compute[75233]: INFO os_vif [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2')
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:23:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No VIF found with MAC fa:16:3e:1b:68:a8, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-01baefbe-2df0-41e7-a26f-bd03d651fc46 req-6b41f47c-c083-4b39-a9b0-c9f5da12cdd1 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01baefbe-2df0-41e7-a26f-bd03d651fc46 req-6b41f47c-c083-4b39-a9b0-c9f5da12cdd1 service nova] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01baefbe-2df0-41e7-a26f-bd03d651fc46 req-6b41f47c-c083-4b39-a9b0-c9f5da12cdd1 service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-01baefbe-2df0-41e7-a26f-bd03d651fc46 req-6b41f47c-c083-4b39-a9b0-c9f5da12cdd1 service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:23:59 user nova-compute[75233]: DEBUG nova.compute.manager [req-01baefbe-2df0-41e7-a26f-bd03d651fc46 req-6b41f47c-c083-4b39-a9b0-c9f5da12cdd1 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] No waiting events found dispatching network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:23:59 user nova-compute[75233]: WARNING nova.compute.manager [req-01baefbe-2df0-41e7-a26f-bd03d651fc46 req-6b41f47c-c083-4b39-a9b0-c9f5da12cdd1 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received unexpected event network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 for instance with vm_state building and task_state spawning.
Dec 05 14:23:59 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:24:01 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Instance spawned successfully.
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:24:01 user nova-compute[75233]: INFO nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Took 4.96 seconds to spawn the instance on the hypervisor.
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-ae4d654b-90b4-4c14-bedb-df7c1fe0eef3 req-fc4eac35-5655-4929-8644-91f4813ab0d0 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae4d654b-90b4-4c14-bedb-df7c1fe0eef3 req-fc4eac35-5655-4929-8644-91f4813ab0d0 service nova] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae4d654b-90b4-4c14-bedb-df7c1fe0eef3 req-fc4eac35-5655-4929-8644-91f4813ab0d0 service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ae4d654b-90b4-4c14-bedb-df7c1fe0eef3 req-fc4eac35-5655-4929-8644-91f4813ab0d0 service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:24:01 user nova-compute[75233]: DEBUG nova.compute.manager [req-ae4d654b-90b4-4c14-bedb-df7c1fe0eef3 req-fc4eac35-5655-4929-8644-91f4813ab0d0 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] No waiting events found dispatching network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:24:01 user nova-compute[75233]: WARNING nova.compute.manager [req-ae4d654b-90b4-4c14-bedb-df7c1fe0eef3 req-fc4eac35-5655-4929-8644-91f4813ab0d0 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received unexpected event network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 for instance with vm_state building and task_state spawning.
Dec 05 14:24:01 user nova-compute[75233]: INFO nova.compute.manager [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Took 14.52 seconds to build instance.
Dec 05 14:24:01 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e2f56a37-56d2-4af3-a1ec-58af70ecb317 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.620s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:24:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:24:15 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:24:18 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:24:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:24:19 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=24.86675262451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:24:19 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:24:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:25 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:24:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:30 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:24:37 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:24:38 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:24:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:24:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:24:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:24:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:24:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:24:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:24:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:24:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:24:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:24:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:25:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:17 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:25:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:25:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:25:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=24.865100860595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:25:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:25:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:25:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:25:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:25:37 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-changed-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Refreshing instance network info cache due to event network-changed-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Refreshing network info cache for port 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updated VIF entry in instance network info cache for port 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-bbce8795-98dd-4e6c-b099-5d316e4acc94 req-79d0d682-3418-4a00-8b4b-9c2e6b8db120 service nova] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:25:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:25:40 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:25:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:25:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:25:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:25:47 user nova-compute[75233]: INFO nova.compute.claims [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Claim successful on node user
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:25:47 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:25:47 user nova-compute[75233]: DEBUG nova.policy [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0980778b5e4b6999590c1f311a1c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9cfadfed75341e8aa2e5b4f87e962d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:25:48 user nova-compute[75233]: INFO nova.virt.block_device [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Booting with volume 92755fd6-7dd7-4636-8d19-38587abefbee at /dev/vda
Dec 05 14:25:48 user nova-compute[75233]: DEBUG os_brick.utils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8db95-b9bb-455c-b2f2-957b4619b917]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec41ee56-12ab-4aea-b0dc-4f65693ab4e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6dc8f2-b3cc-434e-8071-b3b8bcecae05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d8af3a-03bf-4064-acf9-4e49199470ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:25:48 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:25:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bbb66b-a9ee-4b1a-8d48-84fd90050904]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG os_brick.utils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating existing volume attachment record: 56f91d6d-fc0b-43b8-a7a2-7e4644dcbc29 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Successfully created port: e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Successfully updated port: e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquired lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-changed-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.compute.manager [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Refreshing instance network info cache due to event network-changed-e44b0872-1203-41de-a748-41a4a573df21. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] Acquiring lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating instance_info_cache with network_info: [{"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Releasing lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Instance network_info: |[{"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] Acquired lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:25:49 user nova-compute[75233]: DEBUG nova.network.neutron [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Refreshing network info cache for port e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:25:50 user nova-compute[75233]: DEBUG nova.network.neutron [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updated VIF entry in instance network info cache for port e44b0872-1203-41de-a748-41a4a573df21. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:25:50 user nova-compute[75233]: DEBUG nova.network.neutron [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating instance_info_cache with network_info: [{"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:25:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-74523e16-4bb4-4b82-b94b-220c97de3026 req-bf857d09-948b-433f-a86b-7a7d32e87706 service nova] Releasing lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:25:53 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:25:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:25:57 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Creating image(s)
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Did not create local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Ensure instance console log exists: /opt/stack/data/nova/instances/bbdf554d-ceab-40fa-bf7e-b57b21ae25b2/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Start _get_guest_xml network_info=[{"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnhNQsIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbdf554d-ceab-40fa-bf7e-b57b21ae25b2', 'attached_at': '', 'detached_at': '', 'volume_id': '92755fd6-7dd7-4636-8d19-38587abefbee', 'serial': '92755fd6-7dd7-4636-8d19-38587abefbee'}, 'delete_on_termination': False, 'attachment_id': '56f91d6d-fc0b-43b8-a7a2-7e4644dcbc29', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:25:57 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:25:57 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnhNQsIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:25:57 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:25:57 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:25:57 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab9f169-1477-43da-8d46-ee29f7131c3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:25:57 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5991ff-3765-4497-9361-a1802dafdd2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee] added
Dec 05 14:25:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f377cc2-8cd2-4d76-b569-92acf6c06e0d]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1345ba-69bc-4125-bc98-47cae93205ea]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VnhNQsIB {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VnhNQsIB" returned: 0 in 0.024s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffae979-0a2a-4cb8-b633-09bacd4d8695]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VnhNQsIB'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[401bf71f-7e54-435a-9ad6-fe7f499c971b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[99146f0c-7eb6-4b13-bf58-7c845ab090a4]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:25:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:25:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55704b0-9dba-46d7-91cf-86c7549c3ae6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260]
Dec 05 14:25:57 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260] successful.
Dec 05 14:25:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a89bfc-23aa-4751-a660-7b6bed98209a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[724dc081-5d99-4ab9-adaf-83f4f2832681]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:25:57 user nova-compute[75233]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee (non-flash)
Dec 05 14:25:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:25:57 user nova-compute[75233]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee (non-flash)
Dec 05 14:25:57 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[301510d0-fce1-4af5-ace5-3cabc8632fa4]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:25:57 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnhNQsIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26362316162313461', 'path': '/dev/sdc'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362316162313461', 'path': '/dev/sdc'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-680728916',display_name='tempest-TestVolumeBootPattern-server-680728916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-680728916',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-rpsonsqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:25:48Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=bbdf554d-ceab-40fa-bf7e-b57b21ae25b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'pci_devices' on Instance uuid bbdf554d-ceab-40fa-bf7e-b57b21ae25b2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:25:58 user nova-compute[75233]:   <uuid>bbdf554d-ceab-40fa-bf7e-b57b21ae25b2</uuid>
Dec 05 14:25:58 user nova-compute[75233]:   <name>instance-00000034</name>
Dec 05 14:25:58 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:25:58 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:25:58 user nova-compute[75233]:   <metadata>
Dec 05 14:25:58 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:25:58 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:25:58 user nova-compute[75233]:       <nova:name>tempest-TestVolumeBootPattern-server-680728916</nova:name>
Dec 05 14:25:58 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:25:57</nova:creationTime>
Dec 05 14:25:58 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:25:58 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:25:58 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:25:58 user nova-compute[75233]:       <nova:owner>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:user uuid="bc0980778b5e4b6999590c1f311a1c1d">tempest-TestVolumeBootPattern-1094285123-project-member</nova:user>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:project uuid="c9cfadfed75341e8aa2e5b4f87e962d9">tempest-TestVolumeBootPattern-1094285123</nova:project>
Dec 05 14:25:58 user nova-compute[75233]:       </nova:owner>
Dec 05 14:25:58 user nova-compute[75233]:       <nova:ports>
Dec 05 14:25:58 user nova-compute[75233]:         <nova:port uuid="e44b0872-1203-41de-a748-41a4a573df21">
Dec 05 14:25:58 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 14:25:58 user nova-compute[75233]:         </nova:port>
Dec 05 14:25:58 user nova-compute[75233]:       </nova:ports>
Dec 05 14:25:58 user nova-compute[75233]:     </nova:instance>
Dec 05 14:25:58 user nova-compute[75233]:   </metadata>
Dec 05 14:25:58 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:25:58 user nova-compute[75233]:     <system>
Dec 05 14:25:58 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:25:58 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:25:58 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:25:58 user nova-compute[75233]:       <entry name="serial">bbdf554d-ceab-40fa-bf7e-b57b21ae25b2</entry>
Dec 05 14:25:58 user nova-compute[75233]:       <entry name="uuid">bbdf554d-ceab-40fa-bf7e-b57b21ae25b2</entry>
Dec 05 14:25:58 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:25:58 user nova-compute[75233]:     </system>
Dec 05 14:25:58 user nova-compute[75233]:   </sysinfo>
Dec 05 14:25:58 user nova-compute[75233]:   <os>
Dec 05 14:25:58 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:25:58 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:25:58 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:25:58 user nova-compute[75233]:   </os>
Dec 05 14:25:58 user nova-compute[75233]:   <features>
Dec 05 14:25:58 user nova-compute[75233]:     <acpi/>
Dec 05 14:25:58 user nova-compute[75233]:     <apic/>
Dec 05 14:25:58 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:25:58 user nova-compute[75233]:   </features>
Dec 05 14:25:58 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:25:58 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:25:58 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:25:58 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:25:58 user nova-compute[75233]:   </clock>
Dec 05 14:25:58 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:25:58 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:25:58 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:25:58 user nova-compute[75233]:   </cpu>
Dec 05 14:25:58 user nova-compute[75233]:   <devices>
Dec 05 14:25:58 user nova-compute[75233]:     <disk type="block" device="disk">
Dec 05 14:25:58 user nova-compute[75233]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:25:58 user nova-compute[75233]:       <source dev="/dev/sdc"/>
Dec 05 14:25:58 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:25:58 user nova-compute[75233]:       <serial>92755fd6-7dd7-4636-8d19-38587abefbee</serial>
Dec 05 14:25:58 user nova-compute[75233]:     </disk>
Dec 05 14:25:58 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:25:58 user nova-compute[75233]:       <mac address="fa:16:3e:0e:f2:a5"/>
Dec 05 14:25:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:25:58 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:25:58 user nova-compute[75233]:       <target dev="tape44b0872-12"/>
Dec 05 14:25:58 user nova-compute[75233]:     </interface>
Dec 05 14:25:58 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:25:58 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/bbdf554d-ceab-40fa-bf7e-b57b21ae25b2/console.log" append="off"/>
Dec 05 14:25:58 user nova-compute[75233]:     </serial>
Dec 05 14:25:58 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:25:58 user nova-compute[75233]:     <video>
Dec 05 14:25:58 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:25:58 user nova-compute[75233]:     </video>
Dec 05 14:25:58 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:25:58 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:25:58 user nova-compute[75233]:     </rng>
Dec 05 14:25:58 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:25:58 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:25:58 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:25:58 user nova-compute[75233]:     </memballoon>
Dec 05 14:25:58 user nova-compute[75233]:   </devices>
Dec 05 14:25:58 user nova-compute[75233]: </domain>
Dec 05 14:25:58 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-680728916',display_name='tempest-TestVolumeBootPattern-server-680728916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-680728916',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-rpsonsqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:25:48Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=bbdf554d-ceab-40fa-bf7e-b57b21ae25b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG os_vif [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24ef9436-0b24-5771-90e0-fa40d26cb536', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape44b0872-12, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape44b0872-12, col_values=(('qos', UUID('e8ef298d-72ce-40dd-9292-73c1d7beed62')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape44b0872-12, col_values=(('external_ids', {'iface-id': 'e44b0872-1203-41de-a748-41a4a573df21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:f2:a5', 'vm-uuid': 'bbdf554d-ceab-40fa-bf7e-b57b21ae25b2'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:25:58 user nova-compute[75233]: INFO os_vif [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12')
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:25:58 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] No VIF found with MAC fa:16:3e:0e:f2:a5, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-5fa13354-9273-4695-80ec-2ff6635f0540 req-63ab979b-5c50-484a-8cab-a7361064b205 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5fa13354-9273-4695-80ec-2ff6635f0540 req-63ab979b-5c50-484a-8cab-a7361064b205 service nova] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5fa13354-9273-4695-80ec-2ff6635f0540 req-63ab979b-5c50-484a-8cab-a7361064b205 service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5fa13354-9273-4695-80ec-2ff6635f0540 req-63ab979b-5c50-484a-8cab-a7361064b205 service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG nova.compute.manager [req-5fa13354-9273-4695-80ec-2ff6635f0540 req-63ab979b-5c50-484a-8cab-a7361064b205 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] No waiting events found dispatching network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:26:00 user nova-compute[75233]: WARNING nova.compute.manager [req-5fa13354-9273-4695-80ec-2ff6635f0540 req-63ab979b-5c50-484a-8cab-a7361064b205 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received unexpected event network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 for instance with vm_state building and task_state spawning.
Dec 05 14:26:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:26:02 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Instance spawned successfully.
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-9fc2c586-7d97-4660-b809-ad8b1839c5c0 req-bd8eb51c-96a3-46da-845b-262c60b416ff service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fc2c586-7d97-4660-b809-ad8b1839c5c0 req-bd8eb51c-96a3-46da-845b-262c60b416ff service nova] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fc2c586-7d97-4660-b809-ad8b1839c5c0 req-bd8eb51c-96a3-46da-845b-262c60b416ff service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9fc2c586-7d97-4660-b809-ad8b1839c5c0 req-bd8eb51c-96a3-46da-845b-262c60b416ff service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.compute.manager [req-9fc2c586-7d97-4660-b809-ad8b1839c5c0 req-bd8eb51c-96a3-46da-845b-262c60b416ff service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] No waiting events found dispatching network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:26:02 user nova-compute[75233]: WARNING nova.compute.manager [req-9fc2c586-7d97-4660-b809-ad8b1839c5c0 req-bd8eb51c-96a3-46da-845b-262c60b416ff service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received unexpected event network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 for instance with vm_state building and task_state spawning.
Dec 05 14:26:02 user nova-compute[75233]: INFO nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Took 5.09 seconds to spawn the instance on the hypervisor.
Dec 05 14:26:02 user nova-compute[75233]: DEBUG nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:26:02 user nova-compute[75233]: INFO nova.compute.manager [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Took 14.82 seconds to build instance.
Dec 05 14:26:02 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fe86cbe3-0f69-49df-9e07-f7bff1052aff tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.936s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid bbdf554d-ceab-40fa-bf7e-b57b21ae25b2 {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:07 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:26:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:26:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:26:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:26:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:26:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:26:19 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:26:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:26:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:26:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=24.862144470214844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bbdf554d-ceab-40fa-bf7e-b57b21ae25b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:26:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:26:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:26:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:26:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:26:41 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:26:41 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:26:41 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:26:43 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:26:48 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:26:53 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:26:58 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:03 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:13 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:18 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:18 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:27:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:27:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:27:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=24.86151123046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance bbdf554d-ceab-40fa-bf7e-b57b21ae25b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:27:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:27:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:33 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-changed-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG nova.compute.manager [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Refreshing instance network info cache due to event network-changed-e44b0872-1203-41de-a748-41a4a573df21. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] Acquiring lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] Acquired lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Refreshing network info cache for port e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updated VIF entry in instance network info cache for port e44b0872-1203-41de-a748-41a4a573df21. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG nova.network.neutron [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating instance_info_cache with network_info: [{"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:27:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-432bd17b-21ca-4489-87d7-bbd20ca1ea8a req-1899fbf1-7c38-482c-b910-e4f99c2e1e1d service nova] Releasing lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-changed-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Refreshing instance network info cache due to event network-changed-e44b0872-1203-41de-a748-41a4a573df21. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] Acquiring lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] Acquired lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Refreshing network info cache for port e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:40 user nova-compute[75233]: INFO nova.compute.manager [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Terminating instance
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updated VIF entry in instance network info cache for port e44b0872-1203-41de-a748-41a4a573df21. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating instance_info_cache with network_info: [{"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-8bdb0031-e5b1-47e1-bd6e-1aa11aad6664 req-458b84a1-19a5-436c-858d-fd5b7264f5ed service nova] Releasing lock "refresh_cache-bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Instance destroyed successfully.
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'resources' on Instance uuid bbdf554d-ceab-40fa-bf7e-b57b21ae25b2 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-680728916',display_name='tempest-TestVolumeBootPattern-server-680728916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-680728916',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:26:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-rpsonsqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:26:02Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=bbdf554d-ceab-40fa-bf7e-b57b21ae25b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "e44b0872-1203-41de-a748-41a4a573df21", "address": "fa:16:3e:0e:f2:a5", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44b0872-12", "ovs_interfaceid": "e44b0872-1203-41de-a748-41a4a573df21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG os_vif [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape44b0872-12, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8ef298d-72ce-40dd-9292-73c1d7beed62) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:27:40 user nova-compute[75233]: INFO os_vif [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:f2:a5,bridge_name='br-int',has_traffic_filtering=True,id=e44b0872-1203-41de-a748-41a4a573df21,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44b0872-12')
Dec 05 14:27:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VnhNQsIB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:27:40 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:27:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:27:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[20485a25-66b6-4f2b-b4f5-70b2093e8a6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:27:41 user nova-compute[75233]: No targets found.
Dec 05 14:27:41 user nova-compute[75233]: iSNS:
Dec 05 14:27:41 user nova-compute[75233]: No targets found.
Dec 05 14:27:41 user nova-compute[75233]: STATIC:
Dec 05 14:27:41 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee
Dec 05 14:27:41 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:27:41 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:27:41 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34
Dec 05 14:27:41 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:27:41 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:27:41 user nova-compute[75233]: FIRMWARE:
Dec 05 14:27:41 user nova-compute[75233]: No targets found.
Dec 05 14:27:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:27:41 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:27:41 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acee38-770f-4b4f-9148-191926be87d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd30afc-2f90-4616-8443-262ff00efcbd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:27:41 user nova-compute[75233]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee (non-flash)
Dec 05 14:27:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:27:41 user nova-compute[75233]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee (non-flash)
Dec 05 14:27:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34747c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee'): ({'sdc'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Removing single pathed devices sdc {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[34effe3a-fdc7-4987-b823-2c332f5ae350]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1233294-2451-4a56-9cde-6f711c729521]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flushing IO for device /dev/sdc {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3649f-0d76-4880-b2a9-8503c97465e5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2268ae3a-7595-4694-be1b-9246764477ca]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] SCSI volumes sdc have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648811b-f0c6-4fd2-a246-073c0df5494b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af670d-7f66-48b7-b339-1ebe0d9cddee]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260]
Dec 05 14:27:41 user nova-compute[75233]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee, portal: 172.16.0.220,3260] successful.
Dec 05 14:27:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92755fd6-7dd7-4636-8d19-38587abefbee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a96d92-d72d-413e-8abb-4ee79d9b7011]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== disconnect_volume: return (296ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:27:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Deleting instance files /opt/stack/data/nova/instances/bbdf554d-ceab-40fa-bf7e-b57b21ae25b2_del
Dec 05 14:27:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Deletion of /opt/stack/data/nova/instances/bbdf554d-ceab-40fa-bf7e-b57b21ae25b2_del complete
Dec 05 14:27:41 user nova-compute[75233]: INFO nova.compute.manager [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 05 14:27:41 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:27:41 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:27:41 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Took 0.64 seconds to deallocate network for instance.
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-21e8d5ae-c063-4bd5-8820-1caf4fc8a8cf req-1273739a-afbc-4fa4-95f8-2b4e5345539d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-vif-deleted-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:27:42 user nova-compute[75233]: INFO nova.compute.manager [req-21e8d5ae-c063-4bd5-8820-1caf4fc8a8cf req-1273739a-afbc-4fa4-95f8-2b4e5345539d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Neutron deleted interface e44b0872-1203-41de-a748-41a4a573df21; detaching it from the instance and deleting it from the info cache
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.network.neutron [req-21e8d5ae-c063-4bd5-8820-1caf4fc8a8cf req-1273739a-afbc-4fa4-95f8-2b4e5345539d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-21e8d5ae-c063-4bd5-8820-1caf4fc8a8cf req-1273739a-afbc-4fa4-95f8-2b4e5345539d service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Detach interface failed, port_id=e44b0872-1203-41de-a748-41a4a573df21, reason: Instance bbdf554d-ceab-40fa-bf7e-b57b21ae25b2 could not be found. {{(pid=75233) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-vif-unplugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] No waiting events found dispatching network-vif-unplugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-vif-unplugged-e44b0872-1203-41de-a748-41a4a573df21 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received event network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] Acquiring lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] No waiting events found dispatching network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:27:42 user nova-compute[75233]: WARNING nova.compute.manager [req-c08ab1b4-4375-4204-ae79-a77085361ddd req-938b2ef8-e9ed-487a-8ad5-d83b6dbaba16 service nova] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Received unexpected event network-vif-plugged-e44b0872-1203-41de-a748-41a4a573df21 for instance with vm_state active and task_state deleting.
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Skipping network cache update for instance because it is being deleted. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:27:42 user nova-compute[75233]: INFO nova.compute.manager [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: bbdf554d-ceab-40fa-bf7e-b57b21ae25b2] Took 0.89 seconds to detach 1 volumes for instance.
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:27:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:27:43 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:27:43 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:27:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:43 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Deleted allocations for instance bbdf554d-ceab-40fa-bf7e-b57b21ae25b2
Dec 05 14:27:43 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-e35122d8-41c0-4cd6-bfac-3f829bd16584 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "bbdf554d-ceab-40fa-bf7e-b57b21ae25b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.981s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:27:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:27:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:28:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:28:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75233) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:28:21 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.86066436767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:28:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:27 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:28:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:33 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-changed-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Refreshing instance network info cache due to event network-changed-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] Acquiring lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] Acquired lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Refreshing network info cache for port 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:40 user nova-compute[75233]: INFO nova.compute.manager [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Terminating instance
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-5937a6a5-481f-4815-9bad-3f9dfd61cce9 req-7bb7c4da-ad5e-44e0-8810-b01531156df0 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-vif-unplugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5937a6a5-481f-4815-9bad-3f9dfd61cce9 req-7bb7c4da-ad5e-44e0-8810-b01531156df0 service nova] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5937a6a5-481f-4815-9bad-3f9dfd61cce9 req-7bb7c4da-ad5e-44e0-8810-b01531156df0 service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-5937a6a5-481f-4815-9bad-3f9dfd61cce9 req-7bb7c4da-ad5e-44e0-8810-b01531156df0 service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-5937a6a5-481f-4815-9bad-3f9dfd61cce9 req-7bb7c4da-ad5e-44e0-8810-b01531156df0 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] No waiting events found dispatching network-vif-unplugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.compute.manager [req-5937a6a5-481f-4815-9bad-3f9dfd61cce9 req-7bb7c4da-ad5e-44e0-8810-b01531156df0 service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-vif-unplugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updated VIF entry in instance network info cache for port 6a6e945c-b2f1-4f98-b576-1d82a0c5ab79. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.network.neutron [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [{"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9f46ed0c-45cf-47e3-8f8f-60a1542d1559 req-a5ae1157-08d7-4fe6-8e6e-71291ab67c5e service nova] Releasing lock "refresh_cache-378bc083-4b06-45d1-8b49-cdeba4ee8ff4" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Instance destroyed successfully.
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lazy-loading 'resources' on Instance uuid 378bc083-4b06-45d1-8b49-cdeba4ee8ff4 {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1822975577',display_name='tempest-TestVolumeBootPattern-server-1822975577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1822975577',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYGd6hDCxGeMycz/ynUtjJQ1/1MTzM0qIZ/7cN5X7suEZfmcDFxNM9BrMyrvKa50pamUSw3GzgGe0111BzO77dgUBBRbdUBkpH5HZawa4GHRLmyaRDAo5rOHEFQji16+A==',key_name='tempest-TestVolumeBootPattern-597209095',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:24:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9cfadfed75341e8aa2e5b4f87e962d9',ramdisk_id='',reservation_id='r-0hglcsyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1094285123',owner_user_name='tempest-TestVolumeBootPattern-1094285123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:24:02Z,user_data=None,user_id='bc0980778b5e4b6999590c1f311a1c1d',uuid=378bc083-4b06-45d1-8b49-cdeba4ee8ff4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converting VIF {"id": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "address": "fa:16:3e:1b:68:a8", "network": {"id": "b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2012728487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9cfadfed75341e8aa2e5b4f87e962d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6e945c-b2", "ovs_interfaceid": "6a6e945c-b2f1-4f98-b576-1d82a0c5ab79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG os_vif [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a6e945c-b2, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e4c2308-a9e4-4a79-bba3-07da5d3043c6) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:28:40 user nova-compute[75233]: INFO os_vif [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:68:a8,bridge_name='br-int',has_traffic_filtering=True,id=6a6e945c-b2f1-4f98-b576-1d82a0c5ab79,network=Network(b9e8a2e9-240f-4721-aa51-cc5b8ee5b55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6e945c-b2')
Dec 05 14:28:40 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdJpVjNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:28:40 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:28:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:28:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0abf6e-2a9d-458e-9b8f-2a38e709cdb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:28:41 user nova-compute[75233]: No targets found.
Dec 05 14:28:41 user nova-compute[75233]: iSNS:
Dec 05 14:28:41 user nova-compute[75233]: No targets found.
Dec 05 14:28:41 user nova-compute[75233]: STATIC:
Dec 05 14:28:41 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34
Dec 05 14:28:41 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:28:41 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:28:41 user nova-compute[75233]: FIRMWARE:
Dec 05 14:28:41 user nova-compute[75233]: No targets found.
Dec 05 14:28:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:28:41 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:28:41 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c258f9d-662d-484c-83ef-37448ad6c0d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb958f1-23b0-4938-9a93-9087c5fa5b26]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:28:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 (non-flash)
Dec 05 14:28:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f34775e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e15c4-794b-4b43-bce2-028d575f50b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf0347-c428-4217-8392-ec78df2a5a10]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd35b1-c822-42fb-89b7-1b22ed48b050]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4af39e-4126-4dd8-8233-4b19c93c2579]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[451ed6e9-9ebc-4e66-9810-adba1b6dd0dd]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e1861-e8bf-4bec-95ba-29081ea85732]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260]
Dec 05 14:28:41 user nova-compute[75233]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34, portal: 172.16.0.220,3260] successful.
Dec 05 14:28:41 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70281dec-7693-4b93-9a3f-db1a6a910c34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb55443-b9b5-4ec8-8c02-402e99a2d2bb]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] <== disconnect_volume: return (305ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:28:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Deleting instance files /opt/stack/data/nova/instances/378bc083-4b06-45d1-8b49-cdeba4ee8ff4_del
Dec 05 14:28:41 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Deletion of /opt/stack/data/nova/instances/378bc083-4b06-45d1-8b49-cdeba4ee8ff4_del complete
Dec 05 14:28:41 user nova-compute[75233]: INFO nova.compute.manager [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Took 1.21 seconds to destroy the instance on the hypervisor.
Dec 05 14:28:41 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:28:41 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:28:41 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Took 0.46 seconds to deallocate network for instance.
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Skipping network cache update for instance because it is being deleted. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:28:42 user nova-compute[75233]: INFO nova.compute.manager [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Took 0.78 seconds to detach 1 volumes for instance.
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] Acquiring lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] No waiting events found dispatching network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:28:42 user nova-compute[75233]: WARNING nova.compute.manager [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received unexpected event network-vif-plugged-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 for instance with vm_state active and task_state deleting.
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.manager [req-d923295c-4e3e-4b9a-8600-9a22519871fb req-7cdda110-3850-431b-9c69-a569bfec759d service nova] [instance: 378bc083-4b06-45d1-8b49-cdeba4ee8ff4] Received event network-vif-deleted-6a6e945c-b2f1-4f98-b576-1d82a0c5ab79 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:42 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Deleted allocations for instance 378bc083-4b06-45d1-8b49-cdeba4ee8ff4
Dec 05 14:28:42 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6573a8a1-1414-4621-8b49-49e140756de8 tempest-TestVolumeBootPattern-1094285123 tempest-TestVolumeBootPattern-1094285123-project-member] Lock "378bc083-4b06-45d1-8b49-cdeba4ee8ff4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:28:45 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:28:50 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:28:55 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:00 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:29:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:29:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:29:05 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:29:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:29:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:29:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:21 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:29:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:29:22 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:29:22 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=9131MB free_disk=24.85979461669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:29:22 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:29:23 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:29:23 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:29:23 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:29:23 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:29:23 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:29:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:29:25 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:28 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:29:30 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:30 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:29:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:29:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:29:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:29:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:38 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:29:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:29:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:29:43 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:29:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:29:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:30:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:08 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:10 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:11 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:15 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:22 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:23 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:30:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=24.845905303955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Starting instance... {{(pid=75233) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1764}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.338s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75233) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 14:30:24 user nova-compute[75233]: INFO nova.compute.claims [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Claim successful on node user
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Start building networks asynchronously for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Allocating IP information in the background. {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.network.neutron [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] allocate_for_instance() {{(pid=75233) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 14:30:24 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Start building block device mappings for instance. {{(pid=75233) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.policy [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec15349d8ea0466189dc9fae4fd4bc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6eea6aef23428f93b71fcb51f4c661', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75233) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Start spawning the instance on the hypervisor. {{(pid=75233) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 14:30:24 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Creating instance directory {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 05 14:30:25 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Creating image(s)
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "/opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "/opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.190s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.205s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk 1073741824 {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec,backing_fmt=raw /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk 1073741824" returned: 0 in 0.048s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "019d7504bd77239d2cf92b90f85e2d4cbe63ceec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/019d7504bd77239d2cf92b90f85e2d4cbe63ceec --force-share --output=json" returned: 0 in 0.245s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk. size=1073741824 {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG nova.network.neutron [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Successfully created port: af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG nova.virt.disk.api [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Cannot resize image /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk to a smaller size. {{(pid=75233) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Created local disks {{(pid=75233) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Ensure instance console log exists: /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/console.log {{(pid=75233) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.neutron [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Successfully updated port: af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.neutron [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Building network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-changed-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Refreshing instance network info cache due to event network-changed-af592bbc-73bb-415f-ba6a-348131763db3. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.neutron [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Instance cache missing network info. {{(pid=75233) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.neutron [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Instance network_info: |[{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75233) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.neutron [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Refreshing network info cache for port af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Start _get_guest_xml network_info=[{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'b4dfffde-9cf2-443d-89c3-b4ad40b1f06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 05 14:30:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:30:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CPU controller missing on host. {{(pid=75233) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.host [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CPU controller found on host. {{(pid=75233) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75233) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T13:34:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T13:35:04Z,direct_url=<?>,disk_format='qcow2',id=b4dfffde-9cf2-443d-89c3-b4ad40b1f06e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ef190e0b7394693855bd829530ab7a3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T13:35:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Flavor limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Image limits 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Flavor pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Image pref 0:0:0 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Got 1 possible topologies {{(pid=75233) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.hardware [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75233) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-319264741',display_name='tempest-SnapshotDataIntegrityTests-server-319264741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-319264741',id=53,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHi6I6V/SlPae/Az08DMa1Gfs0wrCmkGJIBaQUmbEHvkM/kjWLQs0nlvGaULPLHO8vQxLFRru9n1qhbdMoBcooTw0ZIRnv0iEbxo4OY1cJICdLDgNP6zsYNfO0FFPgmw==',key_name='tempest-keypair-946350474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6eea6aef23428f93b71fcb51f4c661',ramdisk_id='',reservation_id='r-9u3gboa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-563390196',owner_user_name='tempest-SnapshotDataIntegrityTests-563390196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:30:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec15349d8ea0466189dc9fae4fd4bc4c',uuid=b5204026-45cd-4932-8697-be9b87f273ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75233) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Converting VIF {"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.objects.instance [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'pci_devices' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] End _get_guest_xml xml=<domain type="kvm">
Dec 05 14:30:26 user nova-compute[75233]:   <uuid>b5204026-45cd-4932-8697-be9b87f273ee</uuid>
Dec 05 14:30:26 user nova-compute[75233]:   <name>instance-00000035</name>
Dec 05 14:30:26 user nova-compute[75233]:   <memory>524288</memory>
Dec 05 14:30:26 user nova-compute[75233]:   <vcpu>1</vcpu>
Dec 05 14:30:26 user nova-compute[75233]:   <metadata>
Dec 05 14:30:26 user nova-compute[75233]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 14:30:26 user nova-compute[75233]:       <nova:package version="0.0.0"/>
Dec 05 14:30:26 user nova-compute[75233]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-319264741</nova:name>
Dec 05 14:30:26 user nova-compute[75233]:       <nova:creationTime>2023-12-05 14:30:26</nova:creationTime>
Dec 05 14:30:26 user nova-compute[75233]:       <nova:flavor name="m1.tiny">
Dec 05 14:30:26 user nova-compute[75233]:         <nova:memory>512</nova:memory>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:disk>1</nova:disk>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:swap>0</nova:swap>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:vcpus>1</nova:vcpus>
Dec 05 14:30:26 user nova-compute[75233]:       </nova:flavor>
Dec 05 14:30:26 user nova-compute[75233]:       <nova:owner>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:user uuid="ec15349d8ea0466189dc9fae4fd4bc4c">tempest-SnapshotDataIntegrityTests-563390196-project-member</nova:user>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:project uuid="8a6eea6aef23428f93b71fcb51f4c661">tempest-SnapshotDataIntegrityTests-563390196</nova:project>
Dec 05 14:30:26 user nova-compute[75233]:       </nova:owner>
Dec 05 14:30:26 user nova-compute[75233]:       <nova:root type="image" uuid="b4dfffde-9cf2-443d-89c3-b4ad40b1f06e"/>
Dec 05 14:30:26 user nova-compute[75233]:       <nova:ports>
Dec 05 14:30:26 user nova-compute[75233]:         <nova:port uuid="af592bbc-73bb-415f-ba6a-348131763db3">
Dec 05 14:30:26 user nova-compute[75233]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 14:30:26 user nova-compute[75233]:         </nova:port>
Dec 05 14:30:26 user nova-compute[75233]:       </nova:ports>
Dec 05 14:30:26 user nova-compute[75233]:     </nova:instance>
Dec 05 14:30:26 user nova-compute[75233]:   </metadata>
Dec 05 14:30:26 user nova-compute[75233]:   <sysinfo type="smbios">
Dec 05 14:30:26 user nova-compute[75233]:     <system>
Dec 05 14:30:26 user nova-compute[75233]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 14:30:26 user nova-compute[75233]:       <entry name="product">OpenStack Nova</entry>
Dec 05 14:30:26 user nova-compute[75233]:       <entry name="version">0.0.0</entry>
Dec 05 14:30:26 user nova-compute[75233]:       <entry name="serial">b5204026-45cd-4932-8697-be9b87f273ee</entry>
Dec 05 14:30:26 user nova-compute[75233]:       <entry name="uuid">b5204026-45cd-4932-8697-be9b87f273ee</entry>
Dec 05 14:30:26 user nova-compute[75233]:       <entry name="family">Virtual Machine</entry>
Dec 05 14:30:26 user nova-compute[75233]:     </system>
Dec 05 14:30:26 user nova-compute[75233]:   </sysinfo>
Dec 05 14:30:26 user nova-compute[75233]:   <os>
Dec 05 14:30:26 user nova-compute[75233]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 14:30:26 user nova-compute[75233]:     <boot dev="hd"/>
Dec 05 14:30:26 user nova-compute[75233]:     <smbios mode="sysinfo"/>
Dec 05 14:30:26 user nova-compute[75233]:   </os>
Dec 05 14:30:26 user nova-compute[75233]:   <features>
Dec 05 14:30:26 user nova-compute[75233]:     <acpi/>
Dec 05 14:30:26 user nova-compute[75233]:     <apic/>
Dec 05 14:30:26 user nova-compute[75233]:     <vmcoreinfo/>
Dec 05 14:30:26 user nova-compute[75233]:   </features>
Dec 05 14:30:26 user nova-compute[75233]:   <clock offset="utc">
Dec 05 14:30:26 user nova-compute[75233]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 14:30:26 user nova-compute[75233]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 14:30:26 user nova-compute[75233]:     <timer name="hpet" present="no"/>
Dec 05 14:30:26 user nova-compute[75233]:   </clock>
Dec 05 14:30:26 user nova-compute[75233]:   <cpu mode="custom" match="exact">
Dec 05 14:30:26 user nova-compute[75233]:     <model>Nehalem</model>
Dec 05 14:30:26 user nova-compute[75233]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 14:30:26 user nova-compute[75233]:   </cpu>
Dec 05 14:30:26 user nova-compute[75233]:   <devices>
Dec 05 14:30:26 user nova-compute[75233]:     <disk type="file" device="disk">
Dec 05 14:30:26 user nova-compute[75233]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 14:30:26 user nova-compute[75233]:       <source file="/opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk"/>
Dec 05 14:30:26 user nova-compute[75233]:       <target dev="vda" bus="virtio"/>
Dec 05 14:30:26 user nova-compute[75233]:     </disk>
Dec 05 14:30:26 user nova-compute[75233]:     <interface type="ethernet">
Dec 05 14:30:26 user nova-compute[75233]:       <mac address="fa:16:3e:df:f6:61"/>
Dec 05 14:30:26 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:30:26 user nova-compute[75233]:       <mtu size="1442"/>
Dec 05 14:30:26 user nova-compute[75233]:       <target dev="tapaf592bbc-73"/>
Dec 05 14:30:26 user nova-compute[75233]:     </interface>
Dec 05 14:30:26 user nova-compute[75233]:     <serial type="pty">
Dec 05 14:30:26 user nova-compute[75233]:       <log file="/opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/console.log" append="off"/>
Dec 05 14:30:26 user nova-compute[75233]:     </serial>
Dec 05 14:30:26 user nova-compute[75233]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 14:30:26 user nova-compute[75233]:     <video>
Dec 05 14:30:26 user nova-compute[75233]:       <model type="virtio"/>
Dec 05 14:30:26 user nova-compute[75233]:     </video>
Dec 05 14:30:26 user nova-compute[75233]:     <rng model="virtio">
Dec 05 14:30:26 user nova-compute[75233]:       <backend model="random">/dev/urandom</backend>
Dec 05 14:30:26 user nova-compute[75233]:     </rng>
Dec 05 14:30:26 user nova-compute[75233]:     <controller type="usb" index="0" model="none"/>
Dec 05 14:30:26 user nova-compute[75233]:     <memballoon model="virtio">
Dec 05 14:30:26 user nova-compute[75233]:       <stats period="10"/>
Dec 05 14:30:26 user nova-compute[75233]:     </memballoon>
Dec 05 14:30:26 user nova-compute[75233]:   </devices>
Dec 05 14:30:26 user nova-compute[75233]: </domain>
Dec 05 14:30:26 user nova-compute[75233]:  {{(pid=75233) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-319264741',display_name='tempest-SnapshotDataIntegrityTests-server-319264741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-319264741',id=53,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHi6I6V/SlPae/Az08DMa1Gfs0wrCmkGJIBaQUmbEHvkM/kjWLQs0nlvGaULPLHO8vQxLFRru9n1qhbdMoBcooTw0ZIRnv0iEbxo4OY1cJICdLDgNP6zsYNfO0FFPgmw==',key_name='tempest-keypair-946350474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6eea6aef23428f93b71fcb51f4c661',ramdisk_id='',reservation_id='r-9u3gboa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-563390196',owner_user_name='tempest-SnapshotDataIntegrityTests-563390196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T14:30:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec15349d8ea0466189dc9fae4fd4bc4c',uuid=b5204026-45cd-4932-8697-be9b87f273ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Converting VIF {"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG os_vif [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73') {{(pid=75233) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd87115b5-2637-5632-bc1b-c201fda92b48', '_type': 'linux-noop'}}, row=False) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf592bbc-73, may_exist=True, interface_attrs={}) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf592bbc-73, col_values=(('qos', UUID('0104066d-498b-41fb-b40e-7a055a5ef3a3')),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf592bbc-73, col_values=(('external_ids', {'iface-id': 'af592bbc-73bb-415f-ba6a-348131763db3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:f6:61', 'vm-uuid': 'b5204026-45cd-4932-8697-be9b87f273ee'}),), if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:27 user nova-compute[75233]: INFO os_vif [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73')
Dec 05 14:30:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No VIF found with MAC fa:16:3e:df:f6:61, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG nova.network.neutron [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated VIF entry in instance network info cache for port af592bbc-73bb-415f-ba6a-348131763db3. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG nova.network.neutron [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:30:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-ebb5b984-40d2-4582-891c-0f02232050f0 req-b20bf5e3-38d5-44ad-9f5c-915ffedf9be9 service nova] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-e48f73e5-0556-4650-af8a-d7472ba582d7 req-48b5a611-a378-487f-89bf-f401c879ab9e service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e48f73e5-0556-4650-af8a-d7472ba582d7 req-48b5a611-a378-487f-89bf-f401c879ab9e service nova] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e48f73e5-0556-4650-af8a-d7472ba582d7 req-48b5a611-a378-487f-89bf-f401c879ab9e service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-e48f73e5-0556-4650-af8a-d7472ba582d7 req-48b5a611-a378-487f-89bf-f401c879ab9e service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-e48f73e5-0556-4650-af8a-d7472ba582d7 req-48b5a611-a378-487f-89bf-f401c879ab9e service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] No waiting events found dispatching network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:30:28 user nova-compute[75233]: WARNING nova.compute.manager [req-e48f73e5-0556-4650-af8a-d7472ba582d7 req-48b5a611-a378-487f-89bf-f401c879ab9e service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received unexpected event network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 for instance with vm_state building and task_state spawning.
Dec 05 14:30:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Instance event wait completed in 0 seconds for  {{(pid=75233) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Guest created on hypervisor {{(pid=75233) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 14:30:30 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Instance spawned successfully.
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Found default for hw_cdrom_bus of ide {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Found default for hw_disk_bus of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Found default for hw_input_bus of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Found default for hw_pointer_model of None {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Found default for hw_video_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Found default for hw_vif_model of virtio {{(pid=75233) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-fb4151ee-a4aa-4738-a163-db0e6d1217aa req-79f1ac40-1b0e-4e45-90f1-35016f2a08da service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fb4151ee-a4aa-4738-a163-db0e6d1217aa req-79f1ac40-1b0e-4e45-90f1-35016f2a08da service nova] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fb4151ee-a4aa-4738-a163-db0e6d1217aa req-79f1ac40-1b0e-4e45-90f1-35016f2a08da service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-fb4151ee-a4aa-4738-a163-db0e6d1217aa req-79f1ac40-1b0e-4e45-90f1-35016f2a08da service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:30 user nova-compute[75233]: DEBUG nova.compute.manager [req-fb4151ee-a4aa-4738-a163-db0e6d1217aa req-79f1ac40-1b0e-4e45-90f1-35016f2a08da service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] No waiting events found dispatching network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:30:30 user nova-compute[75233]: WARNING nova.compute.manager [req-fb4151ee-a4aa-4738-a163-db0e6d1217aa req-79f1ac40-1b0e-4e45-90f1-35016f2a08da service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received unexpected event network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 for instance with vm_state building and task_state spawning.
Dec 05 14:30:31 user nova-compute[75233]: INFO nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Took 6.01 seconds to spawn the instance on the hypervisor.
Dec 05 14:30:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Checking state {{(pid=75233) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 14:30:31 user nova-compute[75233]: INFO nova.compute.manager [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Took 6.97 seconds to build instance.
Dec 05 14:30:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-28df002b-b90e-4217-8f77-2afb9c86b146 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.100s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:30:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:30:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:30:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:30:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:30:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:49 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:30:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:30:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:55 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:30:55 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:30:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:30:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:31:23 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:31:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:31:24 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.813629150390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:31:24 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:31:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:31:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:31:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:31:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:31:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:31:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:31:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:31:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:31:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:31:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:31:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:31:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:31:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:31:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-changed-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:32:14 user nova-compute[75233]: DEBUG nova.compute.manager [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Refreshing instance network info cache due to event network-changed-af592bbc-73bb-415f-ba6a-348131763db3. {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 14:32:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:32:14 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:32:14 user nova-compute[75233]: DEBUG nova.network.neutron [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Refreshing network info cache for port af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 14:32:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated VIF entry in instance network info cache for port af592bbc-73bb-415f-ba6a-348131763db3. {{(pid=75233) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 14:32:15 user nova-compute[75233]: DEBUG nova.network.neutron [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:32:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-9d2cbf2d-9e16-4e65-92e4-58b2aadfa2b0 req-f0a5ba9e-636f-4fa0-91bc-03a8271f8f6f service nova] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:32:16 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:32:18 user nova-compute[75233]: INFO nova.compute.manager [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attaching volume 5fe61dd3-19db-416d-b646-c4e0fc1f67fb to /dev/vdb
Dec 05 14:32:18 user nova-compute[75233]: DEBUG os_brick.utils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[77021e15-b5c1-481a-95ae-e471f1f711ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b673b01-3289-45e2-9410-8e1c6ba0d53e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[807e82ff-6802-4e1e-98dc-5080899a2204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f827fd-8da1-4c53-9225-ba40da1b58bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:32:18 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:32:18 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdd1653-8a60-44f6-977b-04c70fdee8ed]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG os_brick.utils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:32:18 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating existing volume attachment record: 7e4adfd4-ee6f-4a98-b5b2-239dc787d70e {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:32:21 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:23 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:25 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:32:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.804874420166016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:32:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIYKnldg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:32:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:32:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:32:27 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561ae6c-45f3-427a-b95e-c91dd465690a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:32:27 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8e6f8-daa3-4604-b686-0ca13b39c14f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb] added
Dec 05 14:32:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e087dd7-7a1b-42ab-9378-b23832ef2cab]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f13c682-f602-449f-b770-dee4b2ee4ad3]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIYKnldg {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIYKnldg" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5f781-2ada-4c3a-ae03-483a6d863c9e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIYKnldg'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[83727bf8-c3a8-468a-828e-2f4c9707e2f5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed2d8bb-1216-4d7e-b584-e04d9b35737c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:32:27 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:32:27 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:32:27 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:32:27 user nova-compute[75233]: 
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c69b39-c736-45aa-9799-7f83f236b2b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260]
Dec 05 14:32:27 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260] successful.
Dec 05 14:32:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7ff302-c007-4d94-b230-f1a78d74f2d2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f33bc4-d66e-4786-b727-e6985a109051]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb (non-flash)
Dec 05 14:32:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb (non-flash)
Dec 05 14:32:27 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1960cca-cb8f-443d-8135-388d2168a2b3]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:32:27 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIYKnldg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '23830343632353663', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830343632353663', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG nova.objects.instance [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:32:28 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:32:28 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:32:28 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:32:28 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:32:28 user nova-compute[75233]:   <serial>5fe61dd3-19db-416d-b646-c4e0fc1f67fb</serial>
Dec 05 14:32:28 user nova-compute[75233]: </disk>
Dec 05 14:32:28 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No VIF found with MAC fa:16:3e:df:f6:61, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-1a071f3e-febf-4ae0-9688-173a6edcd64e tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.954s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:32:31 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:36 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:32:44 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:32:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:32:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:32:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:32:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:32:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:32:46 user nova-compute[75233]: INFO nova.compute.manager [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Detaching volume 5fe61dd3-19db-416d-b646-c4e0fc1f67fb
Dec 05 14:32:46 user nova-compute[75233]: INFO nova.virt.block_device [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attempting to driver detach volume 5fe61dd3-19db-416d-b646-c4e0fc1f67fb from mountpoint /dev/vdb
Dec 05 14:32:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Attempting to detach device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:32:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:32:46 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:32:46 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:32:46 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:32:46 user nova-compute[75233]:   <serial>5fe61dd3-19db-416d-b646-c4e0fc1f67fb</serial>
Dec 05 14:32:46 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:32:46 user nova-compute[75233]: </disk>
Dec 05 14:32:46 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:32:46 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config.
Dec 05 14:32:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:32:46 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:32:46 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:32:46 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:32:46 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:32:46 user nova-compute[75233]:   <serial>5fe61dd3-19db-416d-b646-c4e0fc1f67fb</serial>
Dec 05 14:32:46 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:32:46 user nova-compute[75233]: </disk>
Dec 05 14:32:46 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:32:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:47 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:32:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:32:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:33:07 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee is timed out.
Dec 05 14:33:07 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config.
Dec 05 14:33:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIYKnldg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:33:07 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea58752-a3c2-451c-bb80-67fd061981c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:33:07 user nova-compute[75233]: No targets found.
Dec 05 14:33:07 user nova-compute[75233]: iSNS:
Dec 05 14:33:07 user nova-compute[75233]: No targets found.
Dec 05 14:33:07 user nova-compute[75233]: STATIC:
Dec 05 14:33:07 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb
Dec 05 14:33:07 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:33:07 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:33:07 user nova-compute[75233]: FIRMWARE:
Dec 05 14:33:07 user nova-compute[75233]: No targets found.
Dec 05 14:33:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:33:07 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:33:07 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed158a4f-950e-429c-821a-378ae87e8fdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1855d55c-4f39-47ca-b6d4-c392574521e6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb (non-flash)
Dec 05 14:33:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb (non-flash)
Dec 05 14:33:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f585e7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b72602-f341-4189-b8d9-b1fe910a90b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2825ff-64d7-481d-864d-4537faf21cac]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f01f5a-22d8-44ab-abe0-2a1170b5ef0e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77fa43-6b19-40a1-9d8c-a84ecc4a8a22]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b56672-c9c6-4b29-ab6e-ecf5e877c17a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab719046-cf53-4258-a656-33e0b43e915b]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260]
Dec 05 14:33:07 user nova-compute[75233]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb, portal: 172.16.0.220,3260] successful.
Dec 05 14:33:07 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe61dd3-19db-416d-b646-c4e0fc1f67fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddadad59-deac-42f1-9e9b-176d401d8eec]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== disconnect_volume: return (296ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:33:07 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:33:08 user nova-compute[75233]: DEBUG nova.objects.instance [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:33:08 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-42252a56-a22d-4f4a-9246-e961a81f564f tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.648s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:33:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:33:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:27 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:28 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:33:28 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.803783416748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:33:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:33:30 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:30 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:30 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:30 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:33:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:38 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:33:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:33:39 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:33:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:33:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:33:39 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:33:39 user nova-compute[75233]: INFO nova.compute.manager [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attaching volume d5c88c85-5963-4c06-a17a-e41edbbd4239 to /dev/vdb
Dec 05 14:33:40 user nova-compute[75233]: DEBUG os_brick.utils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe56ae-d386-4c94-840f-39262c5c5479]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4512e90-e7b4-4f2f-a160-edc36a30a45f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[028c4096-09c5-42e8-b7a9-6ef9b74b4fcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[158b2068-6fb6-4808-b9ab-df88f90ed242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:33:40 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:33:40 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e223ae-95f6-45db-8292-3045b227fdf0]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG os_brick.utils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:33:40 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating existing volume attachment record: a84c0bc8-7993-424a-b57d-07d4aa54fdf5 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:33:41 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:33:45 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:33:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:33:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:33:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:33:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhEbuLPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:33:48 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:33:48 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:33:48 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e07456-01f0-4760-9f2e-554c6e018017]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:33:48 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeba26d-45c7-448a-9d76-be8fee3e2613]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239] added
Dec 05 14:33:48 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf64e83-8b2b-4769-ac96-1df63ca111c2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241c1bd-6c45-4217-bdd7-8153390dd324]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhEbuLPB {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhEbuLPB" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c0c047-5283-49e6-8f54-13010d2fd816]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhEbuLPB'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:48 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2b7f9-cbb1-4558-a4c2-b5386e48dbe2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6261f15b-8246-41b0-a65d-c611f6c5ece1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:33:49 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:33:49 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:33:49 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:33:49 user nova-compute[75233]: 
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3f6f7-9d1d-4452-a1ae-4cb45b54bdef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260]
Dec 05 14:33:49 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260] successful.
Dec 05 14:33:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f64fad-bca5-4d62-ae95-b053d3557aa1]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7def0-f2d0-44d3-848d-db2f2c62b706]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 (non-flash)
Dec 05 14:33:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 (non-flash)
Dec 05 14:33:49 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac0a95-88a0-4533-9139-43d0b509acc9]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:33:49 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhEbuLPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26631343533336236', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343533336236', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:33:50 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:33:50 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:33:50 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:33:50 user nova-compute[75233]:   <serial>d5c88c85-5963-4c06-a17a-e41edbbd4239</serial>
Dec 05 14:33:50 user nova-compute[75233]: </disk>
Dec 05 14:33:50 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No VIF found with MAC fa:16:3e:df:f6:61, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:33:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb2fc02b-ef78-4b54-b479-4270c5e4a034 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.698s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:33:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:33:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:33:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:33:53 user nova-compute[75233]: INFO nova.compute.manager [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Detaching volume d5c88c85-5963-4c06-a17a-e41edbbd4239
Dec 05 14:33:53 user nova-compute[75233]: INFO nova.virt.block_device [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attempting to driver detach volume d5c88c85-5963-4c06-a17a-e41edbbd4239 from mountpoint /dev/vdb
Dec 05 14:33:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Attempting to detach device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:33:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:33:53 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:33:53 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:33:53 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:33:53 user nova-compute[75233]:   <serial>d5c88c85-5963-4c06-a17a-e41edbbd4239</serial>
Dec 05 14:33:53 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:33:53 user nova-compute[75233]: </disk>
Dec 05 14:33:53 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:33:53 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config.
Dec 05 14:33:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:33:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:33:53 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:33:53 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:33:53 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:33:53 user nova-compute[75233]:   <serial>d5c88c85-5963-4c06-a17a-e41edbbd4239</serial>
Dec 05 14:33:53 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:33:53 user nova-compute[75233]: </disk>
Dec 05 14:33:53 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:33:53 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:33:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:33:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:34:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:34:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:34:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:34:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:34:13 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee is timed out.
Dec 05 14:34:13 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config.
Dec 05 14:34:13 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhEbuLPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:34:13 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[138020ac-b2e2-4173-bd98-3537dca36b27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:34:13 user nova-compute[75233]: No targets found.
Dec 05 14:34:13 user nova-compute[75233]: iSNS:
Dec 05 14:34:13 user nova-compute[75233]: No targets found.
Dec 05 14:34:13 user nova-compute[75233]: STATIC:
Dec 05 14:34:13 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239
Dec 05 14:34:13 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:34:13 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:34:13 user nova-compute[75233]: FIRMWARE:
Dec 05 14:34:13 user nova-compute[75233]: No targets found.
Dec 05 14:34:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:34:13 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:34:13 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a322899-8447-4bfc-a873-84a8a0ed76ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920adff-29fa-42a7-bf07-cf255fc7c458]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 (non-flash)
Dec 05 14:34:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 (non-flash)
Dec 05 14:34:13 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f585e41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17db34-16d1-4295-b40a-c68bb35e0376]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3340663-6519-4fa3-bde4-2e1d3a48fd15]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8728f9-3a61-4eed-8c30-3383a3bcf486]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:34:13 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c893650-3b63-45ee-ad47-237a668b961e]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[725bc10c-c49f-4850-910a-f647275e5b64]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2388ddeb-85f2-4e04-8d10-d33de7302f8b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260]
Dec 05 14:34:14 user nova-compute[75233]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239, portal: 172.16.0.220,3260] successful.
Dec 05 14:34:14 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5c88c85-5963-4c06-a17a-e41edbbd4239 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f934688-daa2-4659-97e3-5cd1daffff59]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== disconnect_volume: return (285ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:34:14 user nova-compute[75233]: DEBUG nova.objects.instance [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:34:15 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-ba243648-cb73-4d1b-8b70-cc92e561755b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:34:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:34:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:34:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.80274200439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:34:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:34:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:31 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:34:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:34:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:34:46 user nova-compute[75233]: INFO nova.compute.manager [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attaching volume 57aa7073-b89a-4943-a7a5-54fc1116e38a to /dev/vdb
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG os_brick.utils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b14d0-5162-4205-b941-015ae2f750e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa852f1e-5936-4804-99a9-f234311ea6a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[17520ba3-c865-4897-b4ad-3596c285ea6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63f078-fca5-4cfc-bfc2-292f233e232e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:34:46 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:34:46 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a75f4a2-4951-4281-96df-a7f1e9fe22c9]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG os_brick.utils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:34:46 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating existing volume attachment record: 4e11438b-619d-4563-9559-069617fd0a15 {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:34:47 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:34:47 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:34:47 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:34:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:51 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvoNFwrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:34:55 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:34:55 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:34:55 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2223e87f-60e8-40a1-bb92-946c58cf30ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:34:55 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[a976ab71-2b9e-4824-be45-66fdaa87db18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a] added
Dec 05 14:34:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f7745-f9db-4da6-9bc6-4d54a99890f8]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d90514-6646-46ab-b084-550bb288217a]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvoNFwrq {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvoNFwrq" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[b908fa87-05ff-43af-9a16-2ca440240251]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WvoNFwrq'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d95467-30c3-4870-a02d-416cff5dbe51]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[93874a0d-2491-4364-99ad-aea3600980f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:34:55 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:34:55 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:34:55 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:34:55 user nova-compute[75233]: 
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3828f-85d2-4999-a303-872805b97635]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260]
Dec 05 14:34:55 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260] successful.
Dec 05 14:34:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f6239c-7ca8-4651-b64d-47b733cbd876]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ca1dd2-f2d8-4e2f-b94f-86100b490389]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a (non-flash)
Dec 05 14:34:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a (non-flash)
Dec 05 14:34:55 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde0e915-b70f-4577-9f90-786f41e7aa69]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:34:55 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvoNFwrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:34:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:34:56 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23336623663663932', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:34:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336623663663932', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:34:56 user nova-compute[75233]: DEBUG nova.objects.instance [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:34:56 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:34:56 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:34:56 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:34:56 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:34:56 user nova-compute[75233]:   <serial>57aa7073-b89a-4943-a7a5-54fc1116e38a</serial>
Dec 05 14:34:56 user nova-compute[75233]: </disk>
Dec 05 14:34:56 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:34:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:34:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:34:57 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No VIF found with MAC fa:16:3e:df:f6:61, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:34:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:34:57 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-f95d4af0-003b-4088-a1d3-d0657d3ba0b1 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.740s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:34:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:34:59 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:34:59 user nova-compute[75233]: INFO nova.compute.manager [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Detaching volume 57aa7073-b89a-4943-a7a5-54fc1116e38a
Dec 05 14:35:00 user nova-compute[75233]: INFO nova.virt.block_device [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attempting to driver detach volume 57aa7073-b89a-4943-a7a5-54fc1116e38a from mountpoint /dev/vdb
Dec 05 14:35:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Attempting to detach device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:35:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:35:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:35:00 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:35:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:35:00 user nova-compute[75233]:   <serial>57aa7073-b89a-4943-a7a5-54fc1116e38a</serial>
Dec 05 14:35:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:35:00 user nova-compute[75233]: </disk>
Dec 05 14:35:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:35:00 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config.
Dec 05 14:35:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:35:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:35:00 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:35:00 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:35:00 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:35:00 user nova-compute[75233]:   <serial>57aa7073-b89a-4943-a7a5-54fc1116e38a</serial>
Dec 05 14:35:00 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:35:00 user nova-compute[75233]: </disk>
Dec 05 14:35:00 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:35:00 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:35:01 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:20 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee is timed out.
Dec 05 14:35:20 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config.
Dec 05 14:35:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvoNFwrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:35:20 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd025171-5526-4ce7-a62f-f9704364634c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:35:20 user nova-compute[75233]: No targets found.
Dec 05 14:35:20 user nova-compute[75233]: iSNS:
Dec 05 14:35:20 user nova-compute[75233]: No targets found.
Dec 05 14:35:20 user nova-compute[75233]: STATIC:
Dec 05 14:35:20 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a
Dec 05 14:35:20 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:35:20 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:35:20 user nova-compute[75233]: FIRMWARE:
Dec 05 14:35:20 user nova-compute[75233]: No targets found.
Dec 05 14:35:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:35:20 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:35:20 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8635f2c4-65d1-40b4-90ec-6c3fd0253747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cd730f-da00-4206-b5fe-d2d5d794ab52]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a (non-flash)
Dec 05 14:35:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a (non-flash)
Dec 05 14:35:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f3479e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03daf8-2c6d-4d18-910f-478eb0f51591]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5050d-e157-47e4-a275-fd8beea670a7]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[1975d50f-3fab-4b53-a2af-1704e2ab053b]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da31fc2-e15c-416f-9b80-d8d3bfaa492c]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1c0565-2736-4875-bd11-00ab0be9e746]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[8360aaa7-883b-4d95-961b-90cd6f81b237]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260]
Dec 05 14:35:20 user nova-compute[75233]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a, portal: 172.16.0.220,3260] successful.
Dec 05 14:35:20 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57aa7073-b89a-4943-a7a5-54fc1116e38a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3a51c-9a0f-4f4f-b25d-d7c63639177e]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== disconnect_volume: return (266ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:35:20 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:35:21 user nova-compute[75233]: DEBUG nova.objects.instance [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:35:21 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-22713973-dda0-4f3a-bd79-3b2d1f0b4e72 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:35:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:24 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:29 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:35:30 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=24.80178451538086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing inventories for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating ProviderTree inventory for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Updating inventory in ProviderTree for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing aggregate associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, aggregates: None {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Refreshing trait associations for resource provider fdab8c34-39de-4e1a-b763-0eb01d8e8585, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE {{(pid=75233) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:35:30 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:35:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:35:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:41 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:35:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:35:48 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:35:49 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:35:49 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:35:49 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:35:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:35:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:35:52 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:35:52 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:35:53 user nova-compute[75233]: INFO nova.compute.manager [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attaching volume 67b5b68d-4594-4277-84cf-378723351f14 to /dev/vdb
Dec 05 14:35:53 user nova-compute[75233]: DEBUG os_brick.utils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e46e38-2941-407d-8d32-a5de0996c593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c0ca9019d661\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db84ca-2baa-4447-b91e-cc57aa85ca32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4638b179-c492-4276-b819-846b91626b7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76e406-381e-4ce8-ae2d-09243c6fcd5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Running cmd (subprocess): nvme version {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] nvme not present on system {{(pid=75233) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 14:35:53 user nova-compute[75233]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 14:35:53 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d97c94-bdd0-4ffc-956e-e7a77d993290]: (4, '') {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75233) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.lightos [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] LIGHTOS: no hostnqn found. {{(pid=75233) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG os_brick.utils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c0ca9019d661', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:35:53 user nova-compute[75233]: DEBUG nova.virt.block_device [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating existing volume attachment record: 1692a9bc-2f23-455e-8544-11fb48ae677c {{(pid=75233) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 14:35:56 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:35:57 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:35:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 14:35:57 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] There are 0 instances to clean {{(pid=75233) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 14:35:59 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:01 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Calling os-brick to attach iSCSI Volume {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 14:36:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQzRZDer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:36:01 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:36:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:36:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:36:01 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:36:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:36:01 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:36:01 user nova-compute[75233]: INFO os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 14:36:01 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e93ee76-bdba-4094-92ac-95003f9c7d22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 14:36:02 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --interface default --op new {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308b0e6-d2db-44d1-bee2-97649df99565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14] added\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14] added
Dec 05 14:36:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6116e362-ab5a-44d9-80f6-699e462f8931]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d759a7e-6528-4e4f-935b-e5f5383d5ec2]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQzRZDer {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQzRZDer" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb5d1e-6f6a-40bd-b030-521729dc77b5]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQzRZDer'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeac8768-3522-4b39-9d2a-5f0547e13d12]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e89855-ed65-4c20-9108-7ca245c82ba9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:36:02 user nova-compute[75233]:  {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 14:36:02 user nova-compute[75233]:  {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:36:02 user nova-compute[75233]: WARNING os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 14:36:02 user nova-compute[75233]: 
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --login {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[3870464b-ce01-43f4-9247-667f5e5e4785]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260]
Dec 05 14:36:02 user nova-compute[75233]: Login to [iface: default, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260] successful.
Dec 05 14:36:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f15bed-3303-462d-aeda-591a055c0a0c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d9677-d1db-4adf-a82f-1e2a39deaf1c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 (non-flash)
Dec 05 14:36:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 (non-flash)
Dec 05 14:36:02 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to 172.16.0.220:3260 {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75233) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75233) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[5356c3f7-0d22-416a-8538-317801b1c5ba]: (4, ('- - 0', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75233) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 14:36:02 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQzRZDer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75233) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26234323832666133', 'path': '/dev/sdb'} {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234323832666133', 'path': '/dev/sdb'} {{(pid=75233) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG nova.objects.instance [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 14:36:03 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:36:03 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:36:03 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:36:03 user nova-compute[75233]:   <serial>67b5b68d-4594-4277-84cf-378723351f14</serial>
Dec 05 14:36:03 user nova-compute[75233]: </disk>
Dec 05 14:36:03 user nova-compute[75233]:  {{(pid=75233) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vda, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75233) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] No VIF found with MAC fa:16:3e:df:f6:61, not building metadata {{(pid=75233) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 05 14:36:03 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-fb57985f-ce50-4eae-bd12-e672abed85f8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.704s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:36:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:36:05 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:36:05 user nova-compute[75233]: INFO nova.compute.manager [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Detaching volume 67b5b68d-4594-4277-84cf-378723351f14
Dec 05 14:36:05 user nova-compute[75233]: INFO nova.virt.block_device [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Attempting to driver detach volume 67b5b68d-4594-4277-84cf-378723351f14 from mountpoint /dev/vdb
Dec 05 14:36:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Attempting to detach device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config. {{(pid=75233) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 14:36:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:36:05 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:36:05 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:36:05 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:36:05 user nova-compute[75233]:   <serial>67b5b68d-4594-4277-84cf-378723351f14</serial>
Dec 05 14:36:05 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:36:05 user nova-compute[75233]: </disk>
Dec 05 14:36:05 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:36:05 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the persistent domain config.
Dec 05 14:36:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config. {{(pid=75233) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 14:36:05 user nova-compute[75233]: DEBUG nova.virt.libvirt.guest [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 14:36:05 user nova-compute[75233]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 14:36:05 user nova-compute[75233]:   <source dev="/dev/sdb"/>
Dec 05 14:36:05 user nova-compute[75233]:   <target dev="vdb" bus="virtio"/>
Dec 05 14:36:05 user nova-compute[75233]:   <serial>67b5b68d-4594-4277-84cf-378723351f14</serial>
Dec 05 14:36:05 user nova-compute[75233]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 14:36:05 user nova-compute[75233]: </disk>
Dec 05 14:36:05 user nova-compute[75233]:  {{(pid=75233) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 14:36:06 user nova-compute[75233]: DEBUG nova.virt.libvirt.driver [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 14:36:06 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:08 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:08 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75233) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 14:36:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:36:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:26 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5204026-45cd-4932-8697-be9b87f273ee is timed out.
Dec 05 14:36:26 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully detached device vdb from instance b5204026-45cd-4932-8697-be9b87f273ee from the live domain config.
Dec 05 14:36:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] calling os-brick to detach iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9f5854cd60>, {'target_iqn': 'iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQzRZDer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 14:36:26 user nova-compute[75233]: WARNING os_brick.initiator.connectors.base [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9dad57-aeef-4a35-aac3-4ac64a6d79f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 14:36:26 user nova-compute[75233]: No targets found.
Dec 05 14:36:26 user nova-compute[75233]: iSNS:
Dec 05 14:36:26 user nova-compute[75233]: No targets found.
Dec 05 14:36:26 user nova-compute[75233]: STATIC:
Dec 05 14:36:26 user nova-compute[75233]: Target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14
Dec 05 14:36:26 user nova-compute[75233]:         Portal: 172.16.0.220:3260,-1
Dec 05 14:36:26 user nova-compute[75233]:                 Iface Name: default
Dec 05 14:36:26 user nova-compute[75233]: FIRMWARE:
Dec 05 14:36:26 user nova-compute[75233]: No targets found.
Dec 05 14:36:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 14:36:26 user nova-compute[75233]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 14:36:26 user nova-compute[75233]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75233) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14', 0)] {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[c156fa65-2c2e-492f-9d93-e24e7b660762]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4398fa8c-f511-4a53-ba59-334a32193423]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 (non-flash)\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 (non-flash)
Dec 05 14:36:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 (non-flash)
Dec 05 14:36:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9f582cf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14'): ({'sdb'}, set())}) {{(pid=75233) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Removing single pathed devices sdb {{(pid=75233) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[4633f986-9d5c-4cf4-aff7-9831d3ee66a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[9872e6c2-b3c3-40c6-a39d-6d984f198037]: (4, ('ok\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Flushing IO for device /dev/sdb {{(pid=75233) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c2f48d-8dd0-4321-841e-6d0229e0c82c]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75233) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a34dc4a-a126-4faa-b463-9b894edd7262]: (4, ('1', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.linuxscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] SCSI volumes sdb have been removed. {{(pid=75233) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14')] {{(pid=75233) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.057s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4b5ff-8c37-4b9c-b664-7f5049419fb9]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --logout {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eeaddb-7652-4785-8c96-9a79645ce012]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260]
Dec 05 14:36:26 user nova-compute[75233]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14, portal: 172.16.0.220,3260] successful.
Dec 05 14:36:26 user nova-compute[75233]:  stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op delete {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67b5b68d-4594-4277-84cf-378723351f14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c6f73c-1fb4-43b5-8383-3eea13ffb3b6]: (4, ('', '')) {{(pid=86205) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75233) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.base [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] <== disconnect_volume: return (336ms) None {{(pid=75233) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Disconnected iSCSI Volume {{(pid=75233) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 14:36:26 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'flavor' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:36:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:27 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-c6a98782-2c98-4785-9dfa-c098de8c509b tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:36:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:29 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Triggering sync for uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 14:36:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:36:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:36:29 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:31 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG oslo_concurrency.processutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75233) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:36:32 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.800758361816406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Instance b5204026-45cd-4932-8697-be9b87f273ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75233) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:36:32 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:36:33 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:33 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:36:34 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:36:40 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:43 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquired lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Forcefully refreshing network info cache for instance {{(pid=75233) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 14:36:50 user nova-compute[75233]: DEBUG nova.objects.instance [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lazy-loading 'info_cache' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:36:51 user nova-compute[75233]: DEBUG nova.network.neutron [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [{"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:36:51 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Releasing lock "refresh_cache-b5204026-45cd-4932-8697-be9b87f273ee" {{(pid=75233) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 14:36:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updated the network info_cache for instance {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 14:36:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:36:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:36:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:36:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:36:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:36:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:26 user nova-compute[75233]: INFO nova.compute.manager [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Terminating instance
Dec 05 14:37:26 user nova-compute[75233]: DEBUG nova.compute.manager [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Start destroying the instance on the hypervisor. {{(pid=75233) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-d25ba699-f316-49d5-99f8-ee0c251a401f req-b40aa7ad-c826-4349-8ac7-f1931bbb7267 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-vif-unplugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d25ba699-f316-49d5-99f8-ee0c251a401f req-b40aa7ad-c826-4349-8ac7-f1931bbb7267 service nova] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d25ba699-f316-49d5-99f8-ee0c251a401f req-b40aa7ad-c826-4349-8ac7-f1931bbb7267 service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-d25ba699-f316-49d5-99f8-ee0c251a401f req-b40aa7ad-c826-4349-8ac7-f1931bbb7267 service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-d25ba699-f316-49d5-99f8-ee0c251a401f req-b40aa7ad-c826-4349-8ac7-f1931bbb7267 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] No waiting events found dispatching network-vif-unplugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG nova.compute.manager [req-d25ba699-f316-49d5-99f8-ee0c251a401f req-b40aa7ad-c826-4349-8ac7-f1931bbb7267 service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-vif-unplugged-af592bbc-73bb-415f-ba6a-348131763db3 for instance with task_state deleting. {{(pid=75233) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 14:37:26 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [-] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Instance destroyed successfully.
Dec 05 14:37:27 user nova-compute[75233]: DEBUG nova.objects.instance [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lazy-loading 'resources' on Instance uuid b5204026-45cd-4932-8697-be9b87f273ee {{(pid=75233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG nova.virt.libvirt.vif [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T14:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-319264741',display_name='tempest-SnapshotDataIntegrityTests-server-319264741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-319264741',id=53,image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHi6I6V/SlPae/Az08DMa1Gfs0wrCmkGJIBaQUmbEHvkM/kjWLQs0nlvGaULPLHO8vQxLFRru9n1qhbdMoBcooTw0ZIRnv0iEbxo4OY1cJICdLDgNP6zsYNfO0FFPgmw==',key_name='tempest-keypair-946350474',keypairs=<?>,launch_index=0,launched_at=2023-12-05T14:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6eea6aef23428f93b71fcb51f4c661',ramdisk_id='',reservation_id='r-9u3gboa2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dfffde-9cf2-443d-89c3-b4ad40b1f06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-563390196',owner_user_name='tempest-SnapshotDataIntegrityTests-563390196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T14:30:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec15349d8ea0466189dc9fae4fd4bc4c',uuid=b5204026-45cd-4932-8697-be9b87f273ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Converting VIF {"id": "af592bbc-73bb-415f-ba6a-348131763db3", "address": "fa:16:3e:df:f6:61", "network": {"id": "3d6b06ea-4fe3-4181-99f6-b91e505b6dde", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224273662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a6eea6aef23428f93b71fcb51f4c661", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf592bbc-73", "ovs_interfaceid": "af592bbc-73bb-415f-ba6a-348131763db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG nova.network.os_vif_util [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73') {{(pid=75233) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG os_vif [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73') {{(pid=75233) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf592bbc-73, bridge=br-int, if_exists=True) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0104066d-498b-41fb-b40e-7a055a5ef3a3) {{(pid=75233) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:27 user nova-compute[75233]: INFO os_vif [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:f6:61,bridge_name='br-int',has_traffic_filtering=True,id=af592bbc-73bb-415f-ba6a-348131763db3,network=Network(3d6b06ea-4fe3-4181-99f6-b91e505b6dde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf592bbc-73')
Dec 05 14:37:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Deleting instance files /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee_del
Dec 05 14:37:27 user nova-compute[75233]: INFO nova.virt.libvirt.driver [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Deletion of /opt/stack/data/nova/instances/b5204026-45cd-4932-8697-be9b87f273ee_del complete
Dec 05 14:37:27 user nova-compute[75233]: INFO nova.compute.manager [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 05 14:37:27 user nova-compute[75233]: DEBUG oslo.service.loopingcall [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75233) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG nova.compute.manager [-] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Deallocating network for instance {{(pid=75233) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: b5204026-45cd-4932-8697-be9b87f273ee] deallocate_for_instance() {{(pid=75233) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 14:37:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG nova.network.neutron [-] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Updating instance_info_cache with network_info: [] {{(pid=75233) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 14:37:28 user nova-compute[75233]: INFO nova.compute.manager [-] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Took 1.40 seconds to deallocate network for instance.
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-80a270e7-7469-4fa8-b795-cce859a7d03e req-f1a9d171-4c37-42d1-a1d3-2d955cd8fa3c service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-vif-deleted-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-040a91be-0eb2-417d-84d9-ffd054d0d490 req-ca3040e1-526d-4f93-a0d2-a022ebbf8aab service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received event network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-040a91be-0eb2-417d-84d9-ffd054d0d490 req-ca3040e1-526d-4f93-a0d2-a022ebbf8aab service nova] Acquiring lock "b5204026-45cd-4932-8697-be9b87f273ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-040a91be-0eb2-417d-84d9-ffd054d0d490 req-ca3040e1-526d-4f93-a0d2-a022ebbf8aab service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [req-040a91be-0eb2-417d-84d9-ffd054d0d490 req-ca3040e1-526d-4f93-a0d2-a022ebbf8aab service nova] Lock "b5204026-45cd-4932-8697-be9b87f273ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:28 user nova-compute[75233]: DEBUG nova.compute.manager [req-040a91be-0eb2-417d-84d9-ffd054d0d490 req-ca3040e1-526d-4f93-a0d2-a022ebbf8aab service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] No waiting events found dispatching network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 {{(pid=75233) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 14:37:28 user nova-compute[75233]: WARNING nova.compute.manager [req-040a91be-0eb2-417d-84d9-ffd054d0d490 req-ca3040e1-526d-4f93-a0d2-a022ebbf8aab service nova] [instance: b5204026-45cd-4932-8697-be9b87f273ee] Received unexpected event network-vif-plugged-af592bbc-73bb-415f-ba6a-348131763db3 for instance with vm_state deleted and task_state None.
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:28 user nova-compute[75233]: INFO nova.scheduler.client.report [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Deleted allocations for instance b5204026-45cd-4932-8697-be9b87f273ee
Dec 05 14:37:28 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-6e261891-fe05-42c0-b4d7-cc46f5d331e8 tempest-SnapshotDataIntegrityTests-563390196 tempest-SnapshotDataIntegrityTests-563390196-project-member] Lock "b5204026-45cd-4932-8697-be9b87f273ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:37:33 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:33 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:33 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:33 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:37:34 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:37:34 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:37:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=24.82788848876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:37:34 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:37:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:42 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:45 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:37:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:37:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:37:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:37:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:48 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:50 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:37:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:37:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:37:50 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:37:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:37:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:38:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:38:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:38:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:38:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:38:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:38:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:38:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:20 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:23 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:27 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:38:33 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:38:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:38:35 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:38:35 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=9249MB free_disk=24.826629638671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:38:35 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:38:36 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:38:36 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:38:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:38:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:38:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:37 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:44 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:46 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:38:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:38:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:38:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:38:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:38:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:38:57 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:02 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:07 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:12 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:17 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:39:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:39:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:39:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:39:22 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:27 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:28 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:29 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:32 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:32 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:32 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75233) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 14:39:33 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75233) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 14:39:36 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:39:36 user nova-compute[75233]: WARNING nova.virt.libvirt.driver [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 14:39:36 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Hypervisor/Node resource view: name=user free_ram=9228MB free_disk=24.81906509399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75233) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 14:39:36 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75233) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG nova.compute.provider_tree [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed in ProviderTree for provider: fdab8c34-39de-4e1a-b763-0eb01d8e8585 {{(pid=75233) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG nova.scheduler.client.report [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Inventory has not changed for provider fdab8c34-39de-4e1a-b763-0eb01d8e8585 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75233) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG nova.compute.resource_tracker [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Compute_service record updated for user:user {{(pid=75233) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG oslo_concurrency.lockutils [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=75233) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 14:39:37 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:39 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:42 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:44 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:47 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:47 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:51 user nova-compute[75233]: DEBUG oslo_service.periodic_task [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75233) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 14:39:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Starting heal instance info cache {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 14:39:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Rebuilding the list of instances to heal {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 14:39:51 user nova-compute[75233]: DEBUG nova.compute.manager [None req-594840f5-81b4-42b1-897e-327b8f695ca9 None None] Didn't find any instances for network info cache update. {{(pid=75233) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 14:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 14:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 14:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75233) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 14:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75233) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 14:39:52 user nova-compute[75233]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75233) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}